Cédric Ollivier [Fri, 3 Dec 2021 16:50:10 +0000 (17:50 +0100)]
Temporarily remove CinderVolumeTypes.create_and_update_volume_type
A few tests are linked to Cinder v2 which was dropped in Xena
Change-Id: I1d7e4ff4cdca61e553738ae79d21eb34033198a8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 26 Nov 2021 16:05:45 +0000 (17:05 +0100)]
Enable RefStack back
Change-Id: Ia87753bb12963c2da9515231b1241860546b7cfe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 25 Nov 2021 16:44:25 +0000 (17:44 +0100)]
Filter test_policy_minimum_bandwidth_rule_rbac in Patrole
https://artifacts.opnfv.org/functest/H5LU90NKXLQX/functest-opnfv-functest-smoke-xena-patrole_admin-run-13/patrole_admin/tempest-report.html
Change-Id: Id4477c52b71147f47c590369a9030dd997c69da6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 25 Nov 2021 13:37:10 +0000 (14:37 +0100)]
Reduce Patrole test case lists
They seem related to Patrole obsolescence
patrole_tempest_plugin.rbac_exceptions.RbacParsingException: Attempted to test an invalid policy file or action
Details: Policy action "volume_extension:types_manage" not found in policy files: [] or among registered policy in code defaults for cinder service.
Change-Id: I2e0bfeb150c8835b47bddac7130021963850397a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 25 Nov 2021 13:24:22 +0000 (14:24 +0100)]
Increate test_count in tempest_slow_cntt
http://artifacts.opnfv.org/functest/6ULJF575WVG6/functest-opnfv-functest-smoke-cntt-xena-tempest_scenario_cntt-run-3/tempest_scenario_cntt/tempest-report.html
Change-Id: I88446714338e46188f61bcac8967196c421f0edd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 25 Nov 2021 13:22:18 +0000 (14:22 +0100)]
Increate test_count in tempest_full_cntt
http://artifacts.opnfv.org/functest/4PVT7P9NXUD4/functest-opnfv-functest-smoke-cntt-xena-tempest_full_cntt-run-3/tempest_full_cntt/tempest-report.html
Change-Id: I1e25aa3ca73c52cf30d69bf6e3932b3505175ea2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 20 Nov 2021 10:28:47 +0000 (11:28 +0100)]
Skip new image import related tests in CNTT
This feature is optional in CNTT.
Change-Id: Iaf2cd7bf8cbba7d4b1f69d51cd41c37842d7bbcd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 20 Nov 2021 10:23:10 +0000 (11:23 +0100)]
Take hostname_fqdn_sanitization into account
It's skipped in CNTT as it's not enabled yet.
Change-Id: Iac3976f4a5fbc2a1e32934bcb4c49877c5753ed4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 10 Nov 2021 14:42:57 +0000 (15:42 +0100)]
Update linters and fix all new issues
It mostly add encoding in open calls and leverage f-strings.
Change-Id: Ifead18fc724a452c1067dcf91dc577032edc9c59
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 9 Nov 2021 14:03:20 +0000 (15:03 +0100)]
Update Xtesting to 0.93.0
Change-Id: Idc5cc6d83d3f4f4786fae533bafeafc1ac9ea245
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 8 Nov 2021 16:00:56 +0000 (17:00 +0100)]
Sync requirements
Change-Id: Id52449163a894bfb5e52c6d4e8c986c246a88a84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 15 Oct 2021 12:50:24 +0000 (14:50 +0200)]
Update RefStack test case descriptions
RefStack now allows skip tests.
Change-Id: I32f57388be81e3ace326c76320a33ca16c01bdba
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Aug 2021 12:09:22 +0000 (14:09 +0200)]
Fallback VMTP to "Support both IPv4 and IPv6 DNS servers when creating networks"
Bootable volume support (bump) is breaking cinder changes removing Cinder v3 [1].
[1] https://opendev.org/x/vmtp/commit/
5ac228a575153e059e3d683d5e125415dd32e89f
Change-Id: Id71332f537203d45ad62dae13745f505f46734b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Aug 2021 11:11:02 +0000 (13:11 +0200)]
Update pylint to latest stable
It also stops filtering py27 which dropped for a while.
Change-Id: Idf19d1d90e0c753b6c05bbe77f3748027c2e0af5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Aug 2021 07:56:52 +0000 (09:56 +0200)]
Switch to provider_vlans public
It follows the new OpenStack gate configs.
Change-Id: I74ae08bf857f092012abab59e108128fc54ddea4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 12 Aug 2021 14:41:38 +0000 (16:41 +0200)]
Update to Alpine 3.14
It also fixes lots of new pylint warnings.
Change-Id: I3376aee5649596c53bc2941ad4d8e0674a2967fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 10 Aug 2021 10:06:14 +0000 (12:06 +0200)]
Select Wallaby as CNTT baseline (Lakelse)
Change-Id: I5637da29b3fa4c43e288ffb5f2306273a5bc2c9e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 30 Jun 2021 13:27:09 +0000 (15:27 +0200)]
Update README.md
It takes Wallaby into account
Change-Id: I529147fd2e80bcc4a19c786b46a0412b32f9ffb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 10 Jun 2021 16:40:09 +0000 (18:40 +0200)]
Remove distlib from constraints
Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console
Change-Id: Ibec464eed800f5b9e7d55bff6bb02f1c43b15aff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 26 May 2021 19:38:27 +0000 (21:38 +0200)]
Remove six from Openstack requirements
Attempting uninstall: six
Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.
https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445
Change-Id: Id31393e9df11920ebebb13cfc4d9080c49a85e52
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 26 May 2021 14:43:29 +0000 (16:43 +0200)]
Add enchant in travis-ci
Change-Id: Ibbf0ecfc0b1e178a27a4981b10689f62fa103d62
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 25 May 2021 14:13:05 +0000 (16:13 +0200)]
Switch to focal in travis-ci gates
Change-Id: Id6d1685762be5d81c5093c05f85c0cc36c234d76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
847a25ffe68aaa98e6101cd66e74144b6c25ea1e)
Cédric Ollivier [Fri, 21 May 2021 16:36:05 +0000 (18:36 +0200)]
Skip new Cinder rbac testing in CNTT
Change-Id: Ic497f405fd60edeb9a19180de8002ebeee81d3cb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 21 May 2021 13:05:19 +0000 (15:05 +0200)]
Skip new Glance testing in CNTT
They ask for features not mandatory in CNTT
Change-Id: I8c1017d2ca76cde90dc8dc66b51d42511bd54ce2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 21 May 2021 12:52:51 +0000 (14:52 +0200)]
Skip new Keystone RBAC testing in CNTT
Change-Id: Ieb0b1992658cc559447e0d5777683c3cac66a766
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
c2d68b7235efca6743350b362daf63cc9960775b)
Cédric Ollivier [Fri, 21 May 2021 12:12:02 +0000 (14:12 +0200)]
Skip test_get_network_ip_availabilities
http://artifacts.opnfv.org/functest/T5HYYAOA3L02/functest-opnfv-functest-smoke-wallaby-patrole_admin-run-7/patrole_admin/tempest-report.html
http://artifacts.opnfv.org/functest/H3A87GU7QKXC/functest-opnfv-functest-smoke-latest-patrole_reader-run-153/patrole_reader/tempest-report.html
Change-Id: I7b2aabdec4bed6928e0672d73627f6ea67f811df
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 19 May 2021 21:45:18 +0000 (23:45 +0200)]
Update test case counts
Change-Id: I5a10da026a98218496de36beb0a92d668514e336
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 18 May 2021 17:21:53 +0000 (19:21 +0200)]
Configure dashboard.dashboard_url if tempest_slow
Tempest Horizon is now also executed in tempest_slow.
Change-Id: I910adc68eeb067d089b705feb794911afd1747e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 18 May 2021 12:00:01 +0000 (14:00 +0200)]
Fix mkfs.ext4 path if Cirros 0.5
Change-Id: I22300ceba2c5ab19fe9912a68d2163f32193c976
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 17 May 2021 14:02:52 +0000 (16:02 +0200)]
Detect OpenStack ussuri
Change-Id: I645913aba06fc87a89fbb5a1a7c090777ca1be7f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 17 May 2021 13:57:25 +0000 (15:57 +0200)]
Update test case counts in CNTT
Change-Id: I8cab1ced6babcc8969d4500784d1fa10dc8f8b6e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
e0af292db068072a1b08879e32fd871237009fcf)
Cédric Ollivier [Mon, 17 May 2021 11:13:18 +0000 (13:13 +0200)]
Update scenario img_file in tempest.conf
It's now an absolute filename [1].
It also updates the cirros version.
[1] https://github.com/openstack/barbican-tempest-plugin/commit/
3f35bff1e19e9ff20bec6d5bbebcd5bb2b10fb49
Change-Id: I6c88b2a6347094466359304d99a2e8195f7ae049
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
c068c042c8a9c02a7ba9c30257e897dab7705b2d)
Cédric Ollivier [Tue, 20 Apr 2021 16:02:00 +0000 (18:02 +0200)]
Refactor test_run_verifier_tests_default
https://app.circleci.com/pipelines/github/collivier/functest/801/workflows/
4e3262ab-3adf-4539-839c-
eddd49bcc2c1/jobs/809
Change-Id: Id2f95a4d8db253449723bf48d190eac7928f038e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 19 Apr 2021 16:39:31 +0000 (18:39 +0200)]
Pin setuptools_scm===6.0.1
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-hunter-build/4/console
Change-Id: I1c8bf76c7e69a65e4193a158c80b17a48a8a3ec2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
21f5124676edb73f76cc819554f074d40d791eda)
(cherry picked from commit
ff8546b16057e6a053ea54de0eac1a2229a7ec75)
Cédric Ollivier [Wed, 17 Feb 2021 22:41:42 +0000 (23:41 +0100)]
Move Functest on Raspberry PI to md
https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI
Change-Id: I7239d89237e7a06ff702ee140f8851e136eb6d87
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 17 Feb 2021 20:37:39 +0000 (21:37 +0100)]
Typos
Change-Id: Ib6972a88644913621dc376367821148286123e9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 17 Feb 2021 20:30:00 +0000 (21:30 +0100)]
Update INFO.yml
Functest has been promoted as Mature.
Badly lots of contributors dropped.
Change-Id: I1cc6542a83df0fabbf67eef9aad535fb27d3bd84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 17 Feb 2021 19:47:33 +0000 (20:47 +0100)]
Fix typo
Change-Id: I1c232d201915e7fe199b5c9cb19cdca878d3e28d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 17 Feb 2021 18:51:09 +0000 (19:51 +0100)]
Publish former wiki page as README.md
https://wiki.opnfv.org/pages/viewpage.action?pageId=
13211751
Change-Id: I3c564bdca64b50b04f353137814ed089ad1b193b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 13 Feb 2021 19:29:02 +0000 (20:29 +0100)]
Upgrade system first
Change-Id: I2d1b7816505370aa326e48c5aba3177a3fa844d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 11 Feb 2021 14:13:00 +0000 (15:13 +0100)]
tempest_horizon has been merged into openstack/tempest
https://github.com/openstack/tempest-horizon/commit/
6883d8ff5a1cc2c20b4fea7b58ba8fcda12ec035
Change-Id: Ib978fdb5f208e0767091eda32bd2103cc88cf47c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 10 Feb 2021 22:46:47 +0000 (23:46 +0100)]
Force ansible-lint===4.2.0
Change-Id: Ic5a08a76d7008d861adf0a83f117e549fb4c12ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 21 Jan 2021 15:52:50 +0000 (16:52 +0100)]
Follow new pip name resolver
Change-Id: Ib185c90b4403a25db55ab0948c2d6bb2b2bc8dfd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 21 Jan 2021 15:52:50 +0000 (16:52 +0100)]
Update to alpine:3.13
Change-Id: I4acdb1f619883bd1e25bb5aef6a9d1722e7bfde5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 10 Dec 2020 21:31:32 +0000 (22:31 +0100)]
Update tempest_neutron test_count to 529
artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html
Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 10 Dec 2020 17:44:20 +0000 (18:44 +0100)]
Use pip==20.2.4 in tox venv
pip 20.3 is disruptive and would lead to big changes in stable
branches.
Change-Id: I33079e7d667e42240fcc497d595509e88da3c4f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 10 Dec 2020 08:32:17 +0000 (09:32 +0100)]
Set NEW_USER ROLE in tempest_heat classic user
Else it fails when member is not the default role.
Change-Id: I1c830705b94a116ef56d83ebcd59145cd40e59a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 9 Dec 2020 17:54:17 +0000 (18:54 +0100)]
Remove all network data in Rally full tasks
Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 9 Dec 2020 15:18:30 +0000 (16:18 +0100)]
Update Rally sanity tasks and blacklists for L2 only
This issues were hidden by Airship limitation (live-migration fails)
Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 9 Dec 2020 11:06:12 +0000 (12:06 +0100)]
Rally_jobs asks for Router in several tasks
NeutronNetworks.create_and_list_ports can be executed when no L3 if
the appropriate params are passed (see rally_sanity and rally_full).
As rally_jobs is an official task which shouldn't be changed, it
simply skips rally_jobs rather than
NeutronNetworks.create_and_list_ports [1]
[1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports
Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 9 Dec 2020 11:04:45 +0000 (12:04 +0100)]
Don't filter vs NO_TENANT_NETWORK in CNTT testcases
This param is incorrect from a CNTT point of view.
It only filters test cases in classical IaaS verification containers.
Change-Id: I8551cb1af28ecb2bea5c29d7c0b692fee41bd119
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 8 Dec 2020 23:06:08 +0000 (00:06 +0100)]
Skip test_minbw_allocation_placement added to tempest_scenario_cntt
http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html
Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 8 Dec 2020 22:27:04 +0000 (23:27 +0100)]
Rather use rconfig.has_option() instead
It slightly increases py2 and py3 to ease next backports.
Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 8 Dec 2020 17:11:06 +0000 (18:11 +0100)]
Skip create_and_update_routers if NO_TENANT_NETWORK
http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers
Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 8 Dec 2020 17:00:42 +0000 (18:00 +0100)]
Skip Restack compute and platform if NO_TENANT_NETWORK
Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 8 Dec 2020 10:32:25 +0000 (11:32 +0100)]
Concat both dynamic and static roles in tempest.conf
It also moves all auth logic in a specific method.
Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 7 Dec 2020 10:40:00 +0000 (11:40 +0100)]
Remove test_reset_network from Patrole test cases
Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service.
http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html
Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 7 Dec 2020 08:00:02 +0000 (09:00 +0100)]
Update NovaServers.boot_server_associate_and_dissociate_floating_ip
It conforms with "Fix nova scenarios for assiciating fips" [1]
http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html
[1] https://github.com/openstack/rally-openstack/commit/
ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460
Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 6 Dec 2020 13:47:41 +0000 (14:47 +0100)]
Update test_count in tempest_full_cntt
http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html
Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 4 Dec 2020 12:48:52 +0000 (13:48 +0100)]
Remove Rally Router testing if no tenant resources
It pleases airship which doesn't support neither routers and floating
ips.
Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 4 Dec 2020 12:01:32 +0000 (13:01 +0100)]
Stop setting floating_ips in tempest_conf.yaml
It's now handled by tempest.py
Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 2 Dec 2020 16:34:06 +0000 (17:34 +0100)]
Remove list_routers call if no tenant network
Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 2 Dec 2020 15:15:57 +0000 (16:15 +0100)]
Update Shaker image as proposed in download.sh
Change-Id: I408a462274245e927b382e008ba146603d82b2e2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 1 Dec 2020 08:05:40 +0000 (09:05 +0100)]
Skip a new upstream test in CNTT tempest_slow
tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance
http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html
Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 30 Nov 2020 15:43:54 +0000 (16:43 +0100)]
Publish CNTT/OPNFV CI assets
It will be introduced to ORAN.
It's also available in [1]
[1] http://testresults.opnfv.org/functest/oran
Change-Id: I00c187a642ca0d03bffcdceed4592632f04d6a8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 29 Nov 2020 18:24:34 +0000 (19:24 +0100)]
Skip the tests now marked as buggy
tempest.api.object_storage.test_object_services.ObjectTest.test_create_object_with_transfer_encoding
Skipped until bug: https://launchpad.net/bugs/
1905432 is resolved.
http://artifacts.opnfv.org/functest/DOI2EPYN3STY/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-178/tempest_full_cntt/tempest-report.html
Change-Id: I0dce32b30d4fa839083975919284c7c4d64850e8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 29 Nov 2020 11:19:48 +0000 (12:19 +0100)]
Clean obsolete OPNFV contraints.
Most of the projects are closed or at best no longer integrated in
Functest features.
Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 28 Nov 2020 09:27:37 +0000 (10:27 +0100)]
Stop duplicating connect_method
This config is now managed dynamically by tempest.py
Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 27 Nov 2020 16:21:08 +0000 (17:21 +0100)]
Replace git.openstack.org by opendev.org
https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console
Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 27 Nov 2020 12:26:46 +0000 (13:26 +0100)]
Protect vs false detected external networks if l2-only
Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 27 Nov 2020 07:56:13 +0000 (08:56 +0100)]
Re-enable xrally_kubernetes master
It mostly reverts the following changes as xrally_kubernetes supports 12.0.0
- xrally_kubernetes fails vs kubernetes 12.0
- patch xrally_kubernetes for kubernetes 12"
https://github.com/xrally/xrally-kubernetes/commit/
2ffa85af2bff3438b6b23034b6ec6ee1de481090
Change-Id: I38a6e3fba35ec2afabd7c849a0cde74d83eece1e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 26 Nov 2020 16:57:23 +0000 (17:57 +0100)]
Skip dataplane benchmarkign if no tenant resources
It asks for routers for instance.
Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 26 Nov 2020 16:40:26 +0000 (17:40 +0100)]
Remove former allow_no_fip logic
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 26 Nov 2020 16:31:58 +0000 (17:31 +0100)]
Allow running cloudify without tenant network resources.
It fits the Airship deployment where there is neither tenant networks
nor floating ips. It skips all VNF test cases as they ask for tenant
resources.
Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 26 Nov 2020 14:55:51 +0000 (15:55 +0100)]
Allow running tempest without tenant network resources.
It fits the Airship deployment where there is neither tenant networks
nor floating ips. It only updates the scenarios and must be completed
by other changes for all the advanced testcases (Rally, Tempest, etc)
Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 24 Nov 2020 10:26:23 +0000 (11:26 +0100)]
Remove rtd-requirements.txt
It's now useless (snaps was removed).
Change-Id: Ide72eb9b4db799fc74161399b469c5f4f68013fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 23 Nov 2020 15:48:26 +0000 (16:48 +0100)]
Slightly update tempest_conf
It completes "Update CNTT regex according to latest tempest changes" [1]
[1] https://gerrit.opnfv.org/gerrit/c/functest/+/71464
Change-Id: Iaf2bcef723f423bff1753e27732edf0fc2242677
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 23 Nov 2020 14:43:44 +0000 (15:43 +0100)]
Remove snaps from rtd requirements
Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 23 Nov 2020 09:11:15 +0000 (10:11 +0100)]
Update CNTT regex according to latest tempest changes
It skips all the new feature testing untill they are mandatory in CNTT
- [compute_feature_enabled] xenapi_apis [1]
- [identity_feature_enabled] access_rules [2]
- [image_feature_enabled] import_image [3]
- [volume_feature_enabled] extend_attached_encrypted_volume [4]
[1] https://review.opendev.org/c/openstack/tempest/+/749527
[2] https://review.opendev.org/c/openstack/tempest/+/699519
[3] https://review.opendev.org/c/openstack/tempest/+/742546
[4] https://review.opendev.org/c/openstack/tempest/+/706904
Change-Id: I161360f882138b46da56b78084a70b244cd1c53d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 22 Nov 2020 21:31:01 +0000 (22:31 +0100)]
Update test count in tempest_heat_cntt
http://artifacts.opnfv.org/functest/OYN5BXIR5ANR/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-143/tempest_heat_cntt/tempest-report.html
Change-Id: I1073988106dac42ecb0e4c6496e9a2957207e274
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 22 Nov 2020 16:34:04 +0000 (17:34 +0100)]
Disable refstack platform and compute
RefStack 2020.06 is obsolete regarding latest OpenStack changes [1]
"Metadata is read-only on non-Xen-based deployments."
[1] http://artifacts.opnfv.org/functest/CX0VIHZZXPK9/functest-opnfv-functest-smoke-latest-refstack_compute-run-737/refstack_compute/tempest-report.html
Change-Id: I6c86ae097d99f1af2cb6a58f3c14fd9b22afe3ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 22 Nov 2020 00:08:39 +0000 (01:08 +0100)]
Patch xrally_kubernetes for kubernetes 12
Then it reverts "xrally_kubernetes fails vs kubernetes 12.0".
https://github.com/collivier/xrally-kubernetes/commit/
10cd8fc1611d8b954532617f75cc90a0277b717e
Change-Id: I3a0beef0b0e6322d3a871a2a90a1c0570ed70a4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 20 Nov 2020 10:44:23 +0000 (11:44 +0100)]
xrally_kubernetes fails vs kubernetes 12.0
It selects Kubernetes 11.0 as opposed to the new OpenStack
upper-constraints.txt [1]. Once xrally_kubernetes is updated,
this patch will be removed.
[1] https://github.com/openstack/requirements/commit/
d8d2e848ec057c47963d33dbd44479fc28e6f38b
Change-Id: I486284a2e67a732048755551a54234852ae3e45f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 19 Nov 2020 15:00:58 +0000 (16:00 +0100)]
Force nics in NovaServers.boot_server_and_list_interfaces
It stops leveraging auto_assign_nic which fails in case of Airship.
Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Nov 2020 15:16:23 +0000 (16:16 +0100)]
Use EXTERNAL_NETWORK as a fallback if no tenant network
It pleases the networking configuration proposed by Airship.
Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 14 Nov 2020 14:31:43 +0000 (15:31 +0100)]
Allow connecting vm to the external network
It fits the Airship deployment where there is neither tenant networks
nor floating ips. It only updates the scenarios and must be completed
by other changes for all the advanced testcases (Rally, Tempest, etc)
Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 12 Nov 2020 16:39:45 +0000 (17:39 +0100)]
Add timeout as needed by Gitlab CI/CD
Gitlab CI/CD sets 1h as default timeout.
The timeout is valid for all test cases in tiers (current XtestingCI
design).
Change-Id: I1ffae060ee8fd26426a9ee9a2ad2cd131ff9abe9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 9 Nov 2020 16:47:47 +0000 (17:47 +0100)]
Run vnfs in parallel
Jenkins slaves must be limited to 2 (default setup) if needed.
Change-Id: Ic05552085988efda0ff4a283ff84942e263750ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 9 Nov 2020 16:47:00 +0000 (17:47 +0100)]
Split Gates in a dedicated site.yml
Change-Id: If470f70359442fabba6c5064f65aff972597131e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 3 Nov 2020 08:03:55 +0000 (09:03 +0100)]
Update tempest_custom in userguide
It was mostly only used by OVP (Functest leverages regexes).
It's now up-to-date about stevedore.
Functest users are free to overwrite any refstack list (e.g.
/home/opnfv/functest/data/refstack/platform.txt) if they want the same
behavior [1].
[1] https://git.opnfv.org/functest/tree/docker/smoke/platform.txt
Co-Authored-By: Roman Kuzmin <rkuzmin@mirantis.com>
Change-Id: I2b6c3ceda102319bfea810ab2a7bf2d911e20f6b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 14 Oct 2020 07:54:09 +0000 (09:54 +0200)]
Publish "Orange CNTT RC1 Field Trial"
It will be introduced during LFN Dev event.
Change-Id: I9e0a048464a8fd99131cccf2741135aacf7e839d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 14 Oct 2020 07:15:49 +0000 (09:15 +0200)]
Publish presentation "OPNFV/CNTT in Orange RFP"
It was introduced during ONES NA 2020 [1][2].
[1] http://testresults.opnfv.org/functest/rfp/
[2] http://testresults.opnfv.org/functest/ONES2020NA_OPNFV-CNTT_RFP.1080p.mp4
Change-Id: I7accf164907d04c56470fbf83fe28363b84ac1bf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 10 Oct 2020 10:47:30 +0000 (12:47 +0200)]
Update results in docs
It takes into account cybort and new patrole testing.
Change-Id: I96ef84c32f792d162bf05399229ba1c4ca7600a8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 5 Oct 2020 11:36:19 +0000 (13:36 +0200)]
Swith to active abot_charm repo
We keep syncing both repos but it helps quickly integrating patches.
Change-Id: Ia6f05994d209e60d1278b7a033317bf7e17e22c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 4 Oct 2020 14:20:27 +0000 (16:20 +0200)]
Modify smoke and benchmarking in Docker From
Change-Id: I0d7acd82f3a4305e862e924d1199c5d28d3ccf56
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 16 Sep 2020 21:24:30 +0000 (23:24 +0200)]
Enable back Patrole volume testing
It skips test_create_network_provider_segmentation_id
as it can run in parallel (200 is hardcoded) and
test_create_image_from_volume_backed_server which
doesn't clean its resources.
Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 16 Sep 2020 08:42:18 +0000 (10:42 +0200)]
Add helm_vims in release notes and console outputs
Change-Id: Iaf8d09046471e4508660ebd34f34278683a449c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 13 Sep 2020 18:37:56 +0000 (20:37 +0200)]
Update kube_bench split in doc
Change-Id: Id4d934f0330bd3338498435a884e33df12850c64
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 8 Sep 2020 07:36:50 +0000 (09:36 +0200)]
Update tempest_neutron test_count to 523
http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html
Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 7 Sep 2020 18:31:01 +0000 (20:31 +0200)]
Skip patrole volume testing
They don't clean volume and snapshot which raises side effects after
lots of iterations. They may be obsolete too [1]
[1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html
Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Code Review / functest.git / log