Pin setuptools_scm===6.0.1

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-hunter-build/4/console

Change-Id: I1c8bf76c7e69a65e4193a158c80b17a48a8a3ec2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 21f5124676edb73f76cc819554f074d40d791eda)
(cherry picked from commit ff8546b16057e6a053ea54de0eac1a2229a7ec75)

Move Functest on Raspberry PI to md

https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI

Change-Id: I7239d89237e7a06ff702ee140f8851e136eb6d87
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a55aa012436df1c22a6f27ece2540067ef61b2f6)

Fix typo

Change-Id: I1c232d201915e7fe199b5c9cb19cdca878d3e28d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2360d16c90c681857e001bb60d92a867029dbff1)

Publish former wiki page as README.md

https://wiki.opnfv.org/pages/viewpage.action?pageId=13211751

Change-Id: I3c564bdca64b50b04f353137814ed089ad1b193b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2145b7bff6c57c0179590bf611f5d0ffe52cfd85)

Upgrade system first

Change-Id: I2d1b7816505370aa326e48c5aba3177a3fa844d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c152b35ecff671ea864ea4c55bcc1a7e244c9f73)

Force ansible-lint===4.2.0

Change-Id: Ic5a08a76d7008d861adf0a83f117e549fb4c12ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4ddf4381275c2fd040dad08ea233b126b8acb19b)

Use pip==20.2.4 in tox venv

pip 20.3 is disruptive and would lead to big changes in stable
branches.

Change-Id: I33079e7d667e42240fcc497d595509e88da3c4f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set NEW_USER ROLE in tempest_heat classic user

Else it fails when member is not the default role.

Change-Id: I1c830705b94a116ef56d83ebcd59145cd40e59a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8d5ddfc2405ec2c454869708e4c020d4e361dd69)

Remove all network data in Rally full tasks

Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 23e6bacad91047d1e9db676eab55a276b7c062ad)

Update Rally sanity tasks and blacklists for L2 only

This issues were hidden by Airship limitation (live-migration fails)

Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit ab616724dabf3fb55205b269916a915821111c55)

Rally_jobs asks for Router in several tasks

NeutronNetworks.create_and_list_ports can be executed when no L3 if
the appropriate params are passed (see rally_sanity and rally_full).

As rally_jobs is an official task which shouldn't be changed, it
simply skips rally_jobs rather than
NeutronNetworks.create_and_list_ports [1]

[1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports

Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 80f380502edf592015df1adf542b6a143da98e7d)

Don't filter vs NO_TENANT_NETWORK in CNTT testcases

This param is incorrect from a CNTT point of view.
It only filters test cases in classical IaaS verification containers.

Change-Id: I8551cb1af28ecb2bea5c29d7c0b692fee41bd119
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d96dde8a04a7787a44a9b4fd5d447f6ffb6acb2b)

Rather use rconfig.has_option() instead

It slightly increases py2 and py3 to ease next backports.

Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 859359c0a4b2afce87beb8ad34fb72c1e3241d4b)

Skip create_and_update_routers if NO_TENANT_NETWORK

http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers

Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2d782c0e7238308e8c2503e00b8e6e299e210855)

Skip Restack compute and platform if NO_TENANT_NETWORK

Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8351a852c23fd68b04b037ff4d53980a85e896ab)

Concat both dynamic and static roles in tempest.conf

It also moves all auth logic in a specific method.

Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8852b2d0128ddde3e45cacf6163000745b00b175)

Remove neutron from upper-constraints

Neutron is the only service defined as upper-constraints.
https://github.com/openstack/requirements/blob/stable/victoria/upper-constraints.txt#L61

Change-Id: Ifeb2bd7203c63171722d691a9e6f3f7b439904e1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update NovaServers.boot_server_associate_and_dissociate_floating_ip

It conforms with "Fix nova scenarios for assiciating fips" [1]

http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html

[1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460

Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5b74f9ce0303202c942f9013a0e09db1014e6ac6)

Remove Rally Router testing if no tenant resources

It pleases airship which doesn't support neither routers and floating
ips.

Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit cdc613aba932c61c7c3250f12a8c7fd76db4b70e)

Stop setting floating_ips in tempest_conf.yaml

It's now handled by tempest.py

Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 47e7b7c59998dfaa76ac8e4c48b47a75538ac90a)

Remove list_routers call if no tenant network

Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dec0d59da6b90afc2e0f385f3573479d6843bb99)

Update Shaker image as proposed in download.sh

Change-Id: I408a462274245e927b382e008ba146603d82b2e2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2f3492206de3c654e0ff735bc905c8cc61caebad)

Clean obsolete OPNFV contraints.

Most of the projects are closed or at best no longer integrated in
Functest features.

Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 1c6c02c8287789d9cd70596628953840014d8d3f)

Stop duplicating connect_method

This config is now managed dynamically by tempest.py

Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 02297608ff5450df9f4efe936c0fc3140be14dfc)

Replace git.openstack.org by opendev.org

https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console

Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a8c884cef8b760183ad08f6034ecdc4ef1fdd4ac)

Protect vs false detected external networks if l2-only

Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3ab6d5693cb303fb73049287e772713a99f84be7)

Skip dataplane benchmarkign if no tenant resources

It asks for routers for instance.

Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f0cac210e048bae9b33180a799af041def5bfb05)

Remove former allow_no_fip logic

Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e28706a10c20bcb359f7d2283802ea9b4ef4bc66)

Allow running cloudify without tenant network resources.

It fits the Airship deployment where there is neither tenant networks
nor floating ips. It skips all VNF test cases as they ask for tenant
resources.

Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 09be8310be708661f2782e6af1d1d84ac0a52946)

Allow running tempest without tenant network resources.

It fits the Airship deployment where there is neither tenant networks
nor floating ips. It only updates the scenarios and must be completed
by other changes for all the advanced testcases (Rally, Tempest, etc)

Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d88bd86e9e5b00f0c5bbbe9df0cb6f3002cb06b0)

Remove rtd-requirements.txt

It's now useless (snaps was removed).

Change-Id: Ide72eb9b4db799fc74161399b469c5f4f68013fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9927d482b35c20fe4d5d227b05f49febf42d6ead)

Remove snaps from rtd requirements

Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 47b5749a1356251f7808e558cd77cfca4d89f6e1)

Force nics in NovaServers.boot_server_and_list_interfaces

It stops leveraging auto_assign_nic which fails in case of Airship.

Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit bbad4b86cfcbe87b4dc5a3c57cb9f0a747a92f1c)

Use EXTERNAL_NETWORK as a fallback if no tenant network

It pleases the networking configuration proposed by Airship.

Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5b96694ec402cede3e0ce3b57fa7e7cff281f179)

Fix branch when calling download_images.sh

Change-Id: Id73f5daab2e4c410e1cc0cfdb0d75b090d6b1c0f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow connecting vm to the external network

It fits the Airship deployment where there is neither tenant networks
nor floating ips. It only updates the scenarios and must be completed
by other changes for all the advanced testcases (Rally, Tempest, etc)

Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d99e61f9eb1c4a582b71eb304259ddd3fdeb748f)

Add timeout as needed by Gitlab CI/CD

Gitlab CI/CD sets 1h as default timeout.
The timeout is valid for all test cases in tiers (current XtestingCI
design).

Change-Id: I1ffae060ee8fd26426a9ee9a2ad2cd131ff9abe9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 19ccc35303f0626a9d62dbbf2be9d8afe3152ea0)

Run vnfs in parallel

Jenkins slaves must be limited to 2 (default setup) if needed.

Change-Id: Ic05552085988efda0ff4a283ff84942e263750ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 03df88bbbb0481ab054343b7304df14037934c66)

Split Gates in a dedicated site.yml

Change-Id: I4bcd2c62923288301713b710ac738c81a83375b2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_custom in userguide

It was mostly only used by OVP (Functest leverages regexes).
It's now up-to-date about stevedore.

Functest users are free to overwrite any refstack list (e.g.
/home/opnfv/functest/data/refstack/platform.txt) if they want the same
behavior [1].

[1] https://git.opnfv.org/functest/tree/docker/smoke/platform.txt

Co-Authored-By: Roman Kuzmin <rkuzmin@mirantis.com>
Change-Id: I2b6c3ceda102319bfea810ab2a7bf2d911e20f6b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5d3e55c9eec208276121b0c4929de568244a7330)

Update all results in docs

It also updates the release notes.

Change-Id: I7413c45c7bf5a85070970f159fb770284e772a6c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Swith to active abot_charm repo

We keep syncing both repos but it helps quickly integrating patches.

Change-Id: Ia6f05994d209e60d1278b7a033317bf7e17e22c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit caf48eebae6c3ffadf1589c5f34d4a272fb09b92)

Update upper-constraints

It takes the new requirements just published into account.

Change-Id: I27619b9deb68d72c9727df669ec413cd383a8c3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Include key tempest 25.0 fix

https://review.opendev.org/#/c/750360/
http://artifacts.opnfv.org/functest/ICQE70OHFZHY/functest-opnfv-functest-smoke-leguer-patrole_admin-run-1/patrole_admin/tempest-report.html

Change-Id: I881a86c72132e18d5d1a753ece6550cd1d978bf6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add Victoria in OpenStack release detection

Change-Id: I0e2b02f6ce5b315da090a5a04ae1c0e40ec114aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Modify smoke and benchmarking in Docker From

Change-Id: I0d7acd82f3a4305e862e924d1199c5d28d3ccf56
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e59aaac6625fcc78de636c90d0738aaf899f2757)

Set Rally and Tempest plugin versions

Change-Id: I26016de521694971327d85919ae2f5b0498f9192
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Prepare Functest Leguer containers

Change-Id: I23363d11cdbe565dfa19e9246afd372756041381
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set default branch in .gitreview

Change-Id: I4ce3d804e26a76c489a3a9df74c48c326356426f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enable back Patrole volume testing

It skips test_create_network_provider_segmentation_id
as it can run in parallel (200 is hardcoded) and
test_create_image_from_volume_backed_server which
doesn't clean its resources.

Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add helm_vims in release notes and console outputs

Change-Id: Iaf8d09046471e4508660ebd34f34278683a449c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update kube_bench split in doc

Change-Id: Id4d934f0330bd3338498435a884e33df12850c64
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_neutron test_count to 523

http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html

Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip patrole volume testing

They don't clean volume and snapshot which raises side effects after
lots of iterations. They may be obsolete too [1]

[1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html

Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip test_backup_crossproject_*_negative

They are currently failing and they don't seem executed in gates [1].

[1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html

Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Functest Kubernetes outputs

Change-Id: I314e232838204f1fb1595cf884957cdf77969615
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove build date which fails spellcheck

https://travis-ci.org/github/collivier/functest/jobs/724612517

Change-Id: Iee849b624870a8106de0167f30bc1e31d47f1f13
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Xtesting to 0.91.0

Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip obsolete Patrole tests

Details: Policy action "os_compute_api:os-floating-ips" not found in policy files: [] or among registered policy in code defaults for nova service.

http://artifacts.opnfv.org/functest/OTNURZ1MTVG3/functest-opnfv-functest-smoke-latest-patrole_reader-run-86/patrole_reader/tempest-report.html

Change-Id: I678b3c10d19006d9ed978c8fa1d9eed933012b84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix functest/ci/testcases.yaml

Even if it's unused, it's keep synced by docker files.

Change-Id: Ia98164c361017392542073745c37b441ec2216d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_full_cntt regexes

http://artifacts.opnfv.org/functest/VX7Y4UA8F07W/functest-pi-ollivier-functest-smoke-cntt-latest-tempest_full_cntt-run-2/tempest_full_cntt/tempest-report.html
https://review.opendev.org/#/c/737634/

Change-Id: I31ea1f30c06cf9cc8c44933a4f1db954db037c53
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update K8s test case results in doc

Change-Id: I655629f539af63deccd6a9c6ad1fb7600f4bde60
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Delete vgpu testcase

It's not longer executed and offered in any Functest container.

Change-Id: I9805eca1e0d7203fecc396398469bccc38458888
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use lower bound for py3-distlib version

Change-Id: I3a97b0cb5fb9c75e7e675370c656325d4c536e8b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Boot a VM to run juju

It allows running juju_epc vs arm32 and arm64.
It stops offering juju in functest-vnf and rather installs it in a VM.

It also adds a couple of missing output decode()

Change-Id: I2218742b2824c8328823051bde32422e56784e90
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Only upgrade py3-distlib"

Only upgrade py3-distlib

https://travis-ci.org/github/collivier/functest/jobs/715442363

Change-Id: Ie34cae67df56b23581e90488c5fa70757efc4b61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Use alpine edge for py3-distlib only"

Use alpine edge for py3-distlib only

Alpine 3.12 doesn't offer a version compatible with latest OpenStack
constraints. It may fix all issues when compiling Functest for arm [1].

[1] https://travis-ci.org/github/collivier/functest/jobs/715229717

Change-Id: I7f55cafff2c7a34909440c5ca1d1f641194761c9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Updated from global requirements

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ibcac0888c7b62d6f59cea7dea021cf64610d38c1

Update docs links

It takes into account Bitergia EOL.

Change-Id: Iaf1292a9b1af8a953ae731037be1954b6c8d5966
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reduce ImportImagesTest regex

It fits last change in ImportImagesTest [1].

[1] http://artifacts.opnfv.org/functest/7WDODZD71WX9/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-159/tempest_full_cntt/tempest-report.html

Change-Id: Ic4e3ca5d0c83696be75b97edb09c4d9a2be7ab30
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Conform with git format-patch for last tempest patch

The patch name must conform with the last commit update.

Change-Id: I493582d41080bd5d8b70d751b68af36ae61bcdc9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Revert ssh_timeout to 196 in Functest

The race condition has been fixed [1] and we can try the timeout used
in OpenStack gates.

[1] https://gerrit.opnfv.org/gerrit/c/functest/+/70606

Change-Id: Iaf8b260c743c1fd0088d31060a43b1788545743c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Increase check_console_loop to 12

It failed once when deeply testing in parallel [1].

https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-jerma-vyos_vrouter-run/80/console

Change-Id: Ia70c43d603302d1bed46d984541b0e71461be4c4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_cinder_cntt test_counts to 11

http://artifacts.opnfv.org/functest/81YZ7LMI0PUW/functest-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-149/tempest_cinder_cntt/tempest-report.html

Change-Id: Ibe7c5ce70262c6fb604bab05038fbd6c408d23f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Apply new Create-new-server-test_reboot_server_hard.patch

test_reboot_server_hard sometimes fail in all gates [1].
This hack could highlight if they are side effects between
test_create_backup and test_reboot_server_hard.

[1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html

Change-Id: I230a6faa4b619e71646a312500ee38a3a8b1093c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip ImportImagesTest.test_image_import in CNTT

ImportImagesTest skipped as image import is not available [1]

[1] http://artifacts.opnfv.org/functest/S9ABQ628T5IG/functest-opnfv-functest-smoke-latest-tempest_full-run-850/tempest_full/tempest-report.html

Change-Id: I1999ed96f546ac7bf2115d205382b3b7f4dfe9af
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add nics net-id when booting dd load test

http://artifacts.opnfv.org/functest/EP1852KPIZEE/functest-opnfv-functest-smoke-latest-rally_sanity-run-920/rally_sanity/rally_sanity.html#/VMTasks.dd_load_test/failures

Change-Id: I959d414692dd52e76175a7341f7d16ef28ab8472
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Print data to debug ServerActionsTestJSON.test_reboot_server_hard

Change-Id: Ib3142be2d6f04315c51831d06e35cc086223603e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Create new server test_reboot_server_hard

It sometimes fail in all gates [1]
This hack could highlight if it's a timeout issue or race conditions
between all tempest tests.

[1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html

Change-Id: I8d03aa10c3d822dacb983e5ca019f79e1c582c9e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rename ext_network to floating_network in Rally tasks

http://artifacts.opnfv.org/functest/TCEP6YYTDWIG/functest-opnfv-functest-benchmarking-latest-rally_full-run-181/rally_full/rally_full.html#/NovaServers.boot_and_associate_floating_ip

Change-Id: I45d666e80a55802ab6c672dfb5f3cf93dc5381bb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Increate neutron_tempest count to 517

http://artifacts.opnfv.org/functest/UM6QD3YXHAAC/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-104/tempest_neutron_cntt/tempest-report.html

Change-Id: If7df0bcd08629ffca60fcb20eb45847199b28e0c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add VMTasks.dd_load_test in Rally test cases

It allows running dd in VM (simple disk benchmarking).

https://github.com/cntt-n/CNTT/issues/1477

Change-Id: I4f1150637460f6e0b661fc80fec2cc292efcc511
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rename ext_network to floating_network in Rally tasks

It now fails [1]:
Traceback (most recent call last):
  File "/src/rally/rally/task/runner.py", line 70, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python3.8/site-packages/rally_openstack/task/scenarios/nova/servers.py", line 1115, in run
    floatingip = self.neutron.create_floatingip(**create_floating_ip_args)
  File "/src/rally/rally/task/service.py", line 114, in wrapper
    return func(instance, *args, **kwargs)
  File "/src/rally/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
TypeError: create_floatingip() got an unexpected keyword argument 'ext_network'

[1] http://artifacts.opnfv.org/functest/JOGVTC31O1IL/functest-opnfv-functest-smoke-latest-rally_sanity-run-905/rally_sanity/rally_sanity.html#/NovaServers.boot_server_associate_and_dissociate_floating_ip/failures

Change-Id: I7157847980b417b814d15e4bf3bbac3c4f114690
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add Patrole compute testing

It stops leveraging on policy json files as it fails for Nova.

Change-Id: Ic70997d0ff8151956dc189739b8468def048aad7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip Patrole test_show_auto_allocated_topology

test_show_auto_allocated_topology doesn't clean its resources:
- network: auto_allocated_network
- subnets: auto_allocated_subnet_v4 & auto_allocated_subnet_v6
- router: auto_allocated_router

This bug easily breaks testing in a quick run when allocating the
subnet due to insufficient prefix space to allocate subnet size /26.

https://build.opnfv.org/ci/job/functest-latest-daily/746/

Change-Id: I1a1bd22068bca0720016dab8a15ad7dd576ee152
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use alpine edge

Last upper-constraints updates force Alpine edge.
https://build.opnfv.org/ci/job/functest-core-docker-build-amd64-master/941/console

Change-Id: If2c7d434cfa45e676e3d236a2f59f916b43b5cd1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use default ssh_timeout (300) in Functest

196 is used in OpenStack gates but it doesn't fit the Functest model.
Functest runs all test cases in parallel vs the same SUT.

https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38

Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add tempest_cyborg in Functest ansible role

Change-Id: I58ae820e10af29be757616fb5faf716453169e25
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add tempest_cyborg based on cyborg tempest plugin

Change-Id: I61e982011040ee8b0540910939983777280445ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Cirros to O.5.1

It conforms to the OpenStack gates which have just updated to Cirros
0.5.1

Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update microversions (Train) in CNTT testing

Baraque selects Train:
https://github.com/cntt-n/CNTT/pull/1782
https://github.com/cntt-n/CNTT/pull/1783

Change-Id: Id9ee50133a3529e4c905b60f993762205178fe7c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enable back manage_snapshot testing in CNTT

Baraque selects Train:
https://github.com/cntt-n/CNTT/pull/1782
https://github.com/cntt-n/CNTT/pull/1783

Change-Id: Ie715a86cf6129ab5b51bf9e0ec07f326c0f86ccb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enable back RemoteStack testing from tempest_heat_cntt

Baraque selects Train:
https://github.com/cntt-n/CNTT/pull/1782
https://github.com/cntt-n/CNTT/pull/1783

Change-Id: I9650f5b9041a59b68af34c7410c64515e498a226
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Patrole tempest list if OVN

Change-Id: I66811c31fac4a83ed9634e928b9af8fa6e633034
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest blacklist if OVN

It takes into account last Patrole changes.

Change-Id: I552442864297b51a1cd7885b357b139b664e536a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove distlib from OpenStack constraints

It raised side effects wih Alpine [1].

[1] https://build.opnfv.org/ci/job/functest-core-docker-build-amd64-master/933/console

Change-Id: Ic922c2b56afe67f2f3e436c562c045f4d0fdbef4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reduce Patrole extra logic

It also reduces the skipped test list taking into account Patrole
improvements.

Change-Id: I23a8c0610a8a4258aa806451f52796f3e7bc46ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Avoid compiling numpy if arm

It reaches Travis-ci timeouts

Change-Id: I30405cc1cd603a9dee96674d350d04eeb39e6add
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>