Skip new Keystone RBAC testing in CNTT

Change-Id: Ieb0b1992658cc559447e0d5777683c3cac66a766
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c2d68b7235efca6743350b362daf63cc9960775b)

Skip test_get_network_ip_availabilities

http://artifacts.opnfv.org/functest/T5HYYAOA3L02/functest-opnfv-functest-smoke-wallaby-patrole_admin-run-7/patrole_admin/tempest-report.html
http://artifacts.opnfv.org/functest/H3A87GU7QKXC/functest-opnfv-functest-smoke-latest-patrole_reader-run-153/patrole_reader/tempest-report.html

Change-Id: I7b2aabdec4bed6928e0672d73627f6ea67f811df
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update test case counts

Change-Id: I5a10da026a98218496de36beb0a92d668514e336
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Configure dashboard.dashboard_url if tempest_slow

Tempest Horizon is now also executed in tempest_slow.

Change-Id: I910adc68eeb067d089b705feb794911afd1747e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix mkfs.ext4 path if Cirros 0.5

Change-Id: I22300ceba2c5ab19fe9912a68d2163f32193c976
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Detect OpenStack ussuri

Change-Id: I645913aba06fc87a89fbb5a1a7c090777ca1be7f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update test case counts in CNTT

Change-Id: I8cab1ced6babcc8969d4500784d1fa10dc8f8b6e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e0af292db068072a1b08879e32fd871237009fcf)

Update scenario img_file in tempest.conf

It's now an absolute filename [1].
It also updates the cirros version.

[1] https://github.com/openstack/barbican-tempest-plugin/commit/3f35bff1e19e9ff20bec6d5bbebcd5bb2b10fb49

Change-Id: I6c88b2a6347094466359304d99a2e8195f7ae049
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c068c042c8a9c02a7ba9c30257e897dab7705b2d)

Refactor test_run_verifier_tests_default

https://app.circleci.com/pipelines/github/collivier/functest/801/workflows/4e3262ab-3adf-4539-839c-eddd49bcc2c1/jobs/809

Change-Id: Id2f95a4d8db253449723bf48d190eac7928f038e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Pin setuptools_scm===6.0.1

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-hunter-build/4/console

Change-Id: I1c8bf76c7e69a65e4193a158c80b17a48a8a3ec2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 21f5124676edb73f76cc819554f074d40d791eda)
(cherry picked from commit ff8546b16057e6a053ea54de0eac1a2229a7ec75)

Move Functest on Raspberry PI to md

https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI

Change-Id: I7239d89237e7a06ff702ee140f8851e136eb6d87
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Typos

Change-Id: Ib6972a88644913621dc376367821148286123e9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update INFO.yml

Functest has been promoted as Mature.
Badly lots of contributors dropped.

Change-Id: I1cc6542a83df0fabbf67eef9aad535fb27d3bd84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix typo

Change-Id: I1c232d201915e7fe199b5c9cb19cdca878d3e28d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Publish former wiki page as README.md

https://wiki.opnfv.org/pages/viewpage.action?pageId=13211751

Change-Id: I3c564bdca64b50b04f353137814ed089ad1b193b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Upgrade system first

Change-Id: I2d1b7816505370aa326e48c5aba3177a3fa844d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

tempest_horizon has been merged into openstack/tempest

https://github.com/openstack/tempest-horizon/commit/6883d8ff5a1cc2c20b4fea7b58ba8fcda12ec035

Change-Id: Ib978fdb5f208e0767091eda32bd2103cc88cf47c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Force ansible-lint===4.2.0

Change-Id: Ic5a08a76d7008d861adf0a83f117e549fb4c12ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Follow new pip name resolver

Change-Id: Ib185c90b4403a25db55ab0948c2d6bb2b2bc8dfd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to alpine:3.13

Change-Id: I4acdb1f619883bd1e25bb5aef6a9d1722e7bfde5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_neutron test_count to 529

artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html

Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use pip==20.2.4 in tox venv

pip 20.3 is disruptive and would lead to big changes in stable
branches.

Change-Id: I33079e7d667e42240fcc497d595509e88da3c4f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set NEW_USER ROLE in tempest_heat classic user

Else it fails when member is not the default role.

Change-Id: I1c830705b94a116ef56d83ebcd59145cd40e59a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove all network data in Rally full tasks

Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Rally sanity tasks and blacklists for L2 only

This issues were hidden by Airship limitation (live-migration fails)

Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rally_jobs asks for Router in several tasks

NeutronNetworks.create_and_list_ports can be executed when no L3 if
the appropriate params are passed (see rally_sanity and rally_full).

As rally_jobs is an official task which shouldn't be changed, it
simply skips rally_jobs rather than
NeutronNetworks.create_and_list_ports [1]

[1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports

Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Don't filter vs NO_TENANT_NETWORK in CNTT testcases

This param is incorrect from a CNTT point of view.
It only filters test cases in classical IaaS verification containers.

Change-Id: I8551cb1af28ecb2bea5c29d7c0b692fee41bd119
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip test_minbw_allocation_placement added to tempest_scenario_cntt

http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html

Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rather use rconfig.has_option() instead

It slightly increases py2 and py3 to ease next backports.

Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip create_and_update_routers if NO_TENANT_NETWORK

http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers

Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip Restack compute and platform if NO_TENANT_NETWORK

Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Concat both dynamic and static roles in tempest.conf

It also moves all auth logic in a specific method.

Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove test_reset_network from Patrole test cases

Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service.

http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html

Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update NovaServers.boot_server_associate_and_dissociate_floating_ip

It conforms with "Fix nova scenarios for assiciating fips" [1]

http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html

[1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460

Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update test_count in tempest_full_cntt

http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html

Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove Rally Router testing if no tenant resources

It pleases airship which doesn't support neither routers and floating
ips.

Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Stop setting floating_ips in tempest_conf.yaml

It's now handled by tempest.py

Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove list_routers call if no tenant network

Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Shaker image as proposed in download.sh

Change-Id: I408a462274245e927b382e008ba146603d82b2e2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip a new upstream test in CNTT tempest_slow

tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance

http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html

Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Publish CNTT/OPNFV CI assets

It will be introduced to ORAN.
It's also available in [1]

[1] http://testresults.opnfv.org/functest/oran

Change-Id: I00c187a642ca0d03bffcdceed4592632f04d6a8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip the tests now marked as buggy

tempest.api.object_storage.test_object_services.ObjectTest.test_create_object_with_transfer_encoding
Skipped until bug: https://launchpad.net/bugs/1905432 is resolved.

http://artifacts.opnfv.org/functest/DOI2EPYN3STY/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-178/tempest_full_cntt/tempest-report.html

Change-Id: I0dce32b30d4fa839083975919284c7c4d64850e8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Clean obsolete OPNFV contraints.

Most of the projects are closed or at best no longer integrated in
Functest features.

Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Stop duplicating connect_method

This config is now managed dynamically by tempest.py

Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Replace git.openstack.org by opendev.org

https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console

Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Protect vs false detected external networks if l2-only

Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Re-enable xrally_kubernetes master

It mostly reverts the following changes as xrally_kubernetes supports 12.0.0
- xrally_kubernetes fails vs kubernetes 12.0
- patch xrally_kubernetes for kubernetes 12"

https://github.com/xrally/xrally-kubernetes/commit/2ffa85af2bff3438b6b23034b6ec6ee1de481090

Change-Id: I38a6e3fba35ec2afabd7c849a0cde74d83eece1e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip dataplane benchmarkign if no tenant resources

It asks for routers for instance.

Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove former allow_no_fip logic

Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow running cloudify without tenant network resources.

It fits the Airship deployment where there is neither tenant networks
nor floating ips. It skips all VNF test cases as they ask for tenant
resources.

Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow running tempest without tenant network resources.

It fits the Airship deployment where there is neither tenant networks
nor floating ips. It only updates the scenarios and must be completed
by other changes for all the advanced testcases (Rally, Tempest, etc)

Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove rtd-requirements.txt

It's now useless (snaps was removed).

Change-Id: Ide72eb9b4db799fc74161399b469c5f4f68013fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Slightly update tempest_conf

It completes "Update CNTT regex according to latest tempest changes" [1]

[1] https://gerrit.opnfv.org/gerrit/c/functest/+/71464

Change-Id: Iaf2bcef723f423bff1753e27732edf0fc2242677
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove snaps from rtd requirements

Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update CNTT regex according to latest tempest changes

It skips all the new feature testing untill they are mandatory in CNTT
- [compute_feature_enabled] xenapi_apis [1]
- [identity_feature_enabled] access_rules [2]
- [image_feature_enabled] import_image [3]
- [volume_feature_enabled] extend_attached_encrypted_volume [4]

[1] https://review.opendev.org/c/openstack/tempest/+/749527
[2] https://review.opendev.org/c/openstack/tempest/+/699519
[3] https://review.opendev.org/c/openstack/tempest/+/742546
[4] https://review.opendev.org/c/openstack/tempest/+/706904

Change-Id: I161360f882138b46da56b78084a70b244cd1c53d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update test count in tempest_heat_cntt

http://artifacts.opnfv.org/functest/OYN5BXIR5ANR/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-143/tempest_heat_cntt/tempest-report.html

Change-Id: I1073988106dac42ecb0e4c6496e9a2957207e274
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Disable refstack platform and compute

RefStack 2020.06 is obsolete regarding latest OpenStack changes [1]
"Metadata is read-only on non-Xen-based deployments."

[1] http://artifacts.opnfv.org/functest/CX0VIHZZXPK9/functest-opnfv-functest-smoke-latest-refstack_compute-run-737/refstack_compute/tempest-report.html

Change-Id: I6c86ae097d99f1af2cb6a58f3c14fd9b22afe3ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Patch xrally_kubernetes for kubernetes 12

Then it reverts "xrally_kubernetes fails vs kubernetes 12.0".

https://github.com/collivier/xrally-kubernetes/commit/10cd8fc1611d8b954532617f75cc90a0277b717e

Change-Id: I3a0beef0b0e6322d3a871a2a90a1c0570ed70a4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

xrally_kubernetes fails vs kubernetes 12.0

It selects Kubernetes 11.0 as opposed to the new OpenStack
upper-constraints.txt [1]. Once xrally_kubernetes is updated,
this patch will be removed.

[1] https://github.com/openstack/requirements/commit/d8d2e848ec057c47963d33dbd44479fc28e6f38b

Change-Id: I486284a2e67a732048755551a54234852ae3e45f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Force nics in NovaServers.boot_server_and_list_interfaces

It stops leveraging auto_assign_nic which fails in case of Airship.

Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use EXTERNAL_NETWORK as a fallback if no tenant network

It pleases the networking configuration proposed by Airship.

Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow connecting vm to the external network

It fits the Airship deployment where there is neither tenant networks
nor floating ips. It only updates the scenarios and must be completed
by other changes for all the advanced testcases (Rally, Tempest, etc)

Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add timeout as needed by Gitlab CI/CD

Gitlab CI/CD sets 1h as default timeout.
The timeout is valid for all test cases in tiers (current XtestingCI
design).

Change-Id: I1ffae060ee8fd26426a9ee9a2ad2cd131ff9abe9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Run vnfs in parallel

Jenkins slaves must be limited to 2 (default setup) if needed.

Change-Id: Ic05552085988efda0ff4a283ff84942e263750ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Split Gates in a dedicated site.yml

Change-Id: If470f70359442fabba6c5064f65aff972597131e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_custom in userguide

It was mostly only used by OVP (Functest leverages regexes).
It's now up-to-date about stevedore.

Functest users are free to overwrite any refstack list (e.g.
/home/opnfv/functest/data/refstack/platform.txt) if they want the same
behavior [1].

[1] https://git.opnfv.org/functest/tree/docker/smoke/platform.txt

Co-Authored-By: Roman Kuzmin <rkuzmin@mirantis.com>
Change-Id: I2b6c3ceda102319bfea810ab2a7bf2d911e20f6b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Publish "Orange CNTT RC1 Field Trial"

It will be introduced during LFN Dev event.

Change-Id: I9e0a048464a8fd99131cccf2741135aacf7e839d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Publish presentation "OPNFV/CNTT in Orange RFP"

It was introduced during ONES NA 2020 [1][2].

[1] http://testresults.opnfv.org/functest/rfp/
[2] http://testresults.opnfv.org/functest/ONES2020NA_OPNFV-CNTT_RFP.1080p.mp4

Change-Id: I7accf164907d04c56470fbf83fe28363b84ac1bf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update results in docs

It takes into account cybort and new patrole testing.

Change-Id: I96ef84c32f792d162bf05399229ba1c4ca7600a8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Swith to active abot_charm repo

We keep syncing both repos but it helps quickly integrating patches.

Change-Id: Ia6f05994d209e60d1278b7a033317bf7e17e22c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Modify smoke and benchmarking in Docker From

Change-Id: I0d7acd82f3a4305e862e924d1199c5d28d3ccf56
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enable back Patrole volume testing

It skips test_create_network_provider_segmentation_id
as it can run in parallel (200 is hardcoded) and
test_create_image_from_volume_backed_server which
doesn't clean its resources.

Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add helm_vims in release notes and console outputs

Change-Id: Iaf8d09046471e4508660ebd34f34278683a449c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update kube_bench split in doc

Change-Id: Id4d934f0330bd3338498435a884e33df12850c64
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_neutron test_count to 523

http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html

Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip patrole volume testing

They don't clean volume and snapshot which raises side effects after
lots of iterations. They may be obsolete too [1]

[1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html

Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip test_backup_crossproject_*_negative

They are currently failing and they don't seem executed in gates [1].

[1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html

Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Functest Kubernetes outputs

Change-Id: I314e232838204f1fb1595cf884957cdf77969615
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove build date which fails spellcheck

https://travis-ci.org/github/collivier/functest/jobs/724612517

Change-Id: Iee849b624870a8106de0167f30bc1e31d47f1f13
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Xtesting to 0.91.0

Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip obsolete Patrole tests

Details: Policy action "os_compute_api:os-floating-ips" not found in policy files: [] or among registered policy in code defaults for nova service.

http://artifacts.opnfv.org/functest/OTNURZ1MTVG3/functest-opnfv-functest-smoke-latest-patrole_reader-run-86/patrole_reader/tempest-report.html

Change-Id: I678b3c10d19006d9ed978c8fa1d9eed933012b84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix functest/ci/testcases.yaml

Even if it's unused, it's keep synced by docker files.

Change-Id: Ia98164c361017392542073745c37b441ec2216d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_full_cntt regexes

http://artifacts.opnfv.org/functest/VX7Y4UA8F07W/functest-pi-ollivier-functest-smoke-cntt-latest-tempest_full_cntt-run-2/tempest_full_cntt/tempest-report.html
https://review.opendev.org/#/c/737634/

Change-Id: I31ea1f30c06cf9cc8c44933a4f1db954db037c53
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update K8s test case results in doc

Change-Id: I655629f539af63deccd6a9c6ad1fb7600f4bde60
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Delete vgpu testcase

It's not longer executed and offered in any Functest container.

Change-Id: I9805eca1e0d7203fecc396398469bccc38458888
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use lower bound for py3-distlib version

Change-Id: I3a97b0cb5fb9c75e7e675370c656325d4c536e8b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Boot a VM to run juju

It allows running juju_epc vs arm32 and arm64.
It stops offering juju in functest-vnf and rather installs it in a VM.

It also adds a couple of missing output decode()

Change-Id: I2218742b2824c8328823051bde32422e56784e90
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Only upgrade py3-distlib"

Only upgrade py3-distlib

https://travis-ci.org/github/collivier/functest/jobs/715442363

Change-Id: Ie34cae67df56b23581e90488c5fa70757efc4b61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Use alpine edge for py3-distlib only"

Use alpine edge for py3-distlib only

Alpine 3.12 doesn't offer a version compatible with latest OpenStack
constraints. It may fix all issues when compiling Functest for arm [1].

[1] https://travis-ci.org/github/collivier/functest/jobs/715229717

Change-Id: I7f55cafff2c7a34909440c5ca1d1f641194761c9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Updated from global requirements

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ibcac0888c7b62d6f59cea7dea021cf64610d38c1

Update docs links

It takes into account Bitergia EOL.

Change-Id: Iaf1292a9b1af8a953ae731037be1954b6c8d5966
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reduce ImportImagesTest regex

It fits last change in ImportImagesTest [1].

[1] http://artifacts.opnfv.org/functest/7WDODZD71WX9/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-159/tempest_full_cntt/tempest-report.html

Change-Id: Ic4e3ca5d0c83696be75b97edb09c4d9a2be7ab30
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Conform with git format-patch for last tempest patch

The patch name must conform with the last commit update.

Change-Id: I493582d41080bd5d8b70d751b68af36ae61bcdc9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Revert ssh_timeout to 196 in Functest

The race condition has been fixed [1] and we can try the timeout used
in OpenStack gates.

[1] https://gerrit.opnfv.org/gerrit/c/functest/+/70606

Change-Id: Iaf8b260c743c1fd0088d31060a43b1788545743c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Increase check_console_loop to 12

It failed once when deeply testing in parallel [1].

https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-jerma-vyos_vrouter-run/80/console

Change-Id: Ia70c43d603302d1bed46d984541b0e71461be4c4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_cinder_cntt test_counts to 11

http://artifacts.opnfv.org/functest/81YZ7LMI0PUW/functest-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-149/tempest_cinder_cntt/tempest-report.html

Change-Id: Ibe7c5ce70262c6fb604bab05038fbd6c408d23f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Apply new Create-new-server-test_reboot_server_hard.patch

test_reboot_server_hard sometimes fail in all gates [1].
This hack could highlight if they are side effects between
test_create_backup and test_reboot_server_hard.

[1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html

Change-Id: I230a6faa4b619e71646a312500ee38a3a8b1093c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip ImportImagesTest.test_image_import in CNTT

ImportImagesTest skipped as image import is not available [1]

[1] http://artifacts.opnfv.org/functest/S9ABQ628T5IG/functest-opnfv-functest-smoke-latest-tempest_full-run-850/tempest_full/tempest-report.html

Change-Id: I1999ed96f546ac7bf2115d205382b3b7f4dfe9af
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>