Remove neutron from upper-constraints

Neutron is the only service defined as upper-constraints.
https://github.com/openstack/requirements/blob/stable/victoria/upper-constraints.txt#L61

Change-Id: Ifeb2bd7203c63171722d691a9e6f3f7b439904e1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update NovaServers.boot_server_associate_and_dissociate_floating_ip

It conforms with "Fix nova scenarios for assiciating fips" [1]

http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html

[1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460

Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5b74f9ce0303202c942f9013a0e09db1014e6ac6)

Remove Rally Router testing if no tenant resources

It pleases airship which doesn't support neither routers and floating
ips.

Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit cdc613aba932c61c7c3250f12a8c7fd76db4b70e)

Stop setting floating_ips in tempest_conf.yaml

It's now handled by tempest.py

Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 47e7b7c59998dfaa76ac8e4c48b47a75538ac90a)

Remove list_routers call if no tenant network

Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dec0d59da6b90afc2e0f385f3573479d6843bb99)

Update Shaker image as proposed in download.sh

Change-Id: I408a462274245e927b382e008ba146603d82b2e2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2f3492206de3c654e0ff735bc905c8cc61caebad)

Clean obsolete OPNFV contraints.

Most of the projects are closed or at best no longer integrated in
Functest features.

Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 1c6c02c8287789d9cd70596628953840014d8d3f)

Stop duplicating connect_method

This config is now managed dynamically by tempest.py

Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 02297608ff5450df9f4efe936c0fc3140be14dfc)

Replace git.openstack.org by opendev.org

https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console

Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a8c884cef8b760183ad08f6034ecdc4ef1fdd4ac)

Protect vs false detected external networks if l2-only

Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3ab6d5693cb303fb73049287e772713a99f84be7)

Skip dataplane benchmarkign if no tenant resources

It asks for routers for instance.

Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f0cac210e048bae9b33180a799af041def5bfb05)

Remove former allow_no_fip logic

Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e28706a10c20bcb359f7d2283802ea9b4ef4bc66)

Allow running cloudify without tenant network resources.

It fits the Airship deployment where there is neither tenant networks
nor floating ips. It skips all VNF test cases as they ask for tenant
resources.

Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 09be8310be708661f2782e6af1d1d84ac0a52946)

Allow running tempest without tenant network resources.

It fits the Airship deployment where there is neither tenant networks
nor floating ips. It only updates the scenarios and must be completed
by other changes for all the advanced testcases (Rally, Tempest, etc)

Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d88bd86e9e5b00f0c5bbbe9df0cb6f3002cb06b0)

Remove rtd-requirements.txt

It's now useless (snaps was removed).

Change-Id: Ide72eb9b4db799fc74161399b469c5f4f68013fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9927d482b35c20fe4d5d227b05f49febf42d6ead)

Remove snaps from rtd requirements

Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 47b5749a1356251f7808e558cd77cfca4d89f6e1)

Force nics in NovaServers.boot_server_and_list_interfaces

It stops leveraging auto_assign_nic which fails in case of Airship.

Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit bbad4b86cfcbe87b4dc5a3c57cb9f0a747a92f1c)

Use EXTERNAL_NETWORK as a fallback if no tenant network

It pleases the networking configuration proposed by Airship.

Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5b96694ec402cede3e0ce3b57fa7e7cff281f179)

Fix branch when calling download_images.sh

Change-Id: Id73f5daab2e4c410e1cc0cfdb0d75b090d6b1c0f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow connecting vm to the external network

It fits the Airship deployment where there is neither tenant networks
nor floating ips. It only updates the scenarios and must be completed
by other changes for all the advanced testcases (Rally, Tempest, etc)

Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d99e61f9eb1c4a582b71eb304259ddd3fdeb748f)

Add timeout as needed by Gitlab CI/CD

Gitlab CI/CD sets 1h as default timeout.
The timeout is valid for all test cases in tiers (current XtestingCI
design).

Change-Id: I1ffae060ee8fd26426a9ee9a2ad2cd131ff9abe9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 19ccc35303f0626a9d62dbbf2be9d8afe3152ea0)

Run vnfs in parallel

Jenkins slaves must be limited to 2 (default setup) if needed.

Change-Id: Ic05552085988efda0ff4a283ff84942e263750ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 03df88bbbb0481ab054343b7304df14037934c66)

Split Gates in a dedicated site.yml

Change-Id: I4bcd2c62923288301713b710ac738c81a83375b2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_custom in userguide

It was mostly only used by OVP (Functest leverages regexes).
It's now up-to-date about stevedore.

Functest users are free to overwrite any refstack list (e.g.
/home/opnfv/functest/data/refstack/platform.txt) if they want the same
behavior [1].

[1] https://git.opnfv.org/functest/tree/docker/smoke/platform.txt

Co-Authored-By: Roman Kuzmin <rkuzmin@mirantis.com>
Change-Id: I2b6c3ceda102319bfea810ab2a7bf2d911e20f6b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5d3e55c9eec208276121b0c4929de568244a7330)

Update all results in docs

It also updates the release notes.

Change-Id: I7413c45c7bf5a85070970f159fb770284e772a6c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Swith to active abot_charm repo

We keep syncing both repos but it helps quickly integrating patches.

Change-Id: Ia6f05994d209e60d1278b7a033317bf7e17e22c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit caf48eebae6c3ffadf1589c5f34d4a272fb09b92)

Update upper-constraints

It takes the new requirements just published into account.

Change-Id: I27619b9deb68d72c9727df669ec413cd383a8c3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Include key tempest 25.0 fix

https://review.opendev.org/#/c/750360/
http://artifacts.opnfv.org/functest/ICQE70OHFZHY/functest-opnfv-functest-smoke-leguer-patrole_admin-run-1/patrole_admin/tempest-report.html

Change-Id: I881a86c72132e18d5d1a753ece6550cd1d978bf6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add Victoria in OpenStack release detection

Change-Id: I0e2b02f6ce5b315da090a5a04ae1c0e40ec114aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Modify smoke and benchmarking in Docker From

Change-Id: I0d7acd82f3a4305e862e924d1199c5d28d3ccf56
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e59aaac6625fcc78de636c90d0738aaf899f2757)

Set Rally and Tempest plugin versions

Change-Id: I26016de521694971327d85919ae2f5b0498f9192
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Prepare Functest Leguer containers

Change-Id: I23363d11cdbe565dfa19e9246afd372756041381
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set default branch in .gitreview

Change-Id: I4ce3d804e26a76c489a3a9df74c48c326356426f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enable back Patrole volume testing

It skips test_create_network_provider_segmentation_id
as it can run in parallel (200 is hardcoded) and
test_create_image_from_volume_backed_server which
doesn't clean its resources.

Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add helm_vims in release notes and console outputs

Change-Id: Iaf8d09046471e4508660ebd34f34278683a449c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update kube_bench split in doc

Change-Id: Id4d934f0330bd3338498435a884e33df12850c64
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_neutron test_count to 523

http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html

Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip patrole volume testing

They don't clean volume and snapshot which raises side effects after
lots of iterations. They may be obsolete too [1]

[1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html

Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip test_backup_crossproject_*_negative

They are currently failing and they don't seem executed in gates [1].

[1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html

Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Functest Kubernetes outputs

Change-Id: I314e232838204f1fb1595cf884957cdf77969615
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove build date which fails spellcheck

https://travis-ci.org/github/collivier/functest/jobs/724612517

Change-Id: Iee849b624870a8106de0167f30bc1e31d47f1f13
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Xtesting to 0.91.0

Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip obsolete Patrole tests

Details: Policy action "os_compute_api:os-floating-ips" not found in policy files: [] or among registered policy in code defaults for nova service.

http://artifacts.opnfv.org/functest/OTNURZ1MTVG3/functest-opnfv-functest-smoke-latest-patrole_reader-run-86/patrole_reader/tempest-report.html

Change-Id: I678b3c10d19006d9ed978c8fa1d9eed933012b84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix functest/ci/testcases.yaml

Even if it's unused, it's keep synced by docker files.

Change-Id: Ia98164c361017392542073745c37b441ec2216d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_full_cntt regexes

http://artifacts.opnfv.org/functest/VX7Y4UA8F07W/functest-pi-ollivier-functest-smoke-cntt-latest-tempest_full_cntt-run-2/tempest_full_cntt/tempest-report.html
https://review.opendev.org/#/c/737634/

Change-Id: I31ea1f30c06cf9cc8c44933a4f1db954db037c53
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update K8s test case results in doc

Change-Id: I655629f539af63deccd6a9c6ad1fb7600f4bde60
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Delete vgpu testcase

It's not longer executed and offered in any Functest container.

Change-Id: I9805eca1e0d7203fecc396398469bccc38458888
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use lower bound for py3-distlib version

Change-Id: I3a97b0cb5fb9c75e7e675370c656325d4c536e8b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Boot a VM to run juju

It allows running juju_epc vs arm32 and arm64.
It stops offering juju in functest-vnf and rather installs it in a VM.

It also adds a couple of missing output decode()

Change-Id: I2218742b2824c8328823051bde32422e56784e90
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Only upgrade py3-distlib"

Only upgrade py3-distlib

https://travis-ci.org/github/collivier/functest/jobs/715442363

Change-Id: Ie34cae67df56b23581e90488c5fa70757efc4b61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Use alpine edge for py3-distlib only"

Use alpine edge for py3-distlib only

Alpine 3.12 doesn't offer a version compatible with latest OpenStack
constraints. It may fix all issues when compiling Functest for arm [1].

[1] https://travis-ci.org/github/collivier/functest/jobs/715229717

Change-Id: I7f55cafff2c7a34909440c5ca1d1f641194761c9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Updated from global requirements

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ibcac0888c7b62d6f59cea7dea021cf64610d38c1

Update docs links

It takes into account Bitergia EOL.

Change-Id: Iaf1292a9b1af8a953ae731037be1954b6c8d5966
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reduce ImportImagesTest regex

It fits last change in ImportImagesTest [1].

[1] http://artifacts.opnfv.org/functest/7WDODZD71WX9/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-159/tempest_full_cntt/tempest-report.html

Change-Id: Ic4e3ca5d0c83696be75b97edb09c4d9a2be7ab30
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Conform with git format-patch for last tempest patch

The patch name must conform with the last commit update.

Change-Id: I493582d41080bd5d8b70d751b68af36ae61bcdc9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Revert ssh_timeout to 196 in Functest

The race condition has been fixed [1] and we can try the timeout used
in OpenStack gates.

[1] https://gerrit.opnfv.org/gerrit/c/functest/+/70606

Change-Id: Iaf8b260c743c1fd0088d31060a43b1788545743c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Increase check_console_loop to 12

It failed once when deeply testing in parallel [1].

https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-jerma-vyos_vrouter-run/80/console

Change-Id: Ia70c43d603302d1bed46d984541b0e71461be4c4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_cinder_cntt test_counts to 11

http://artifacts.opnfv.org/functest/81YZ7LMI0PUW/functest-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-149/tempest_cinder_cntt/tempest-report.html

Change-Id: Ibe7c5ce70262c6fb604bab05038fbd6c408d23f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Apply new Create-new-server-test_reboot_server_hard.patch

test_reboot_server_hard sometimes fail in all gates [1].
This hack could highlight if they are side effects between
test_create_backup and test_reboot_server_hard.

[1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html

Change-Id: I230a6faa4b619e71646a312500ee38a3a8b1093c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip ImportImagesTest.test_image_import in CNTT

ImportImagesTest skipped as image import is not available [1]

[1] http://artifacts.opnfv.org/functest/S9ABQ628T5IG/functest-opnfv-functest-smoke-latest-tempest_full-run-850/tempest_full/tempest-report.html

Change-Id: I1999ed96f546ac7bf2115d205382b3b7f4dfe9af
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add nics net-id when booting dd load test

http://artifacts.opnfv.org/functest/EP1852KPIZEE/functest-opnfv-functest-smoke-latest-rally_sanity-run-920/rally_sanity/rally_sanity.html#/VMTasks.dd_load_test/failures

Change-Id: I959d414692dd52e76175a7341f7d16ef28ab8472
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Print data to debug ServerActionsTestJSON.test_reboot_server_hard

Change-Id: Ib3142be2d6f04315c51831d06e35cc086223603e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Create new server test_reboot_server_hard

It sometimes fail in all gates [1]
This hack could highlight if it's a timeout issue or race conditions
between all tempest tests.

[1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html

Change-Id: I8d03aa10c3d822dacb983e5ca019f79e1c582c9e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rename ext_network to floating_network in Rally tasks

http://artifacts.opnfv.org/functest/TCEP6YYTDWIG/functest-opnfv-functest-benchmarking-latest-rally_full-run-181/rally_full/rally_full.html#/NovaServers.boot_and_associate_floating_ip

Change-Id: I45d666e80a55802ab6c672dfb5f3cf93dc5381bb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Increate neutron_tempest count to 517

http://artifacts.opnfv.org/functest/UM6QD3YXHAAC/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-104/tempest_neutron_cntt/tempest-report.html

Change-Id: If7df0bcd08629ffca60fcb20eb45847199b28e0c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add VMTasks.dd_load_test in Rally test cases

It allows running dd in VM (simple disk benchmarking).

https://github.com/cntt-n/CNTT/issues/1477

Change-Id: I4f1150637460f6e0b661fc80fec2cc292efcc511
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rename ext_network to floating_network in Rally tasks

It now fails [1]:
Traceback (most recent call last):
  File "/src/rally/rally/task/runner.py", line 70, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python3.8/site-packages/rally_openstack/task/scenarios/nova/servers.py", line 1115, in run
    floatingip = self.neutron.create_floatingip(**create_floating_ip_args)
  File "/src/rally/rally/task/service.py", line 114, in wrapper
    return func(instance, *args, **kwargs)
  File "/src/rally/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
TypeError: create_floatingip() got an unexpected keyword argument 'ext_network'

[1] http://artifacts.opnfv.org/functest/JOGVTC31O1IL/functest-opnfv-functest-smoke-latest-rally_sanity-run-905/rally_sanity/rally_sanity.html#/NovaServers.boot_server_associate_and_dissociate_floating_ip/failures

Change-Id: I7157847980b417b814d15e4bf3bbac3c4f114690
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add Patrole compute testing

It stops leveraging on policy json files as it fails for Nova.

Change-Id: Ic70997d0ff8151956dc189739b8468def048aad7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip Patrole test_show_auto_allocated_topology

test_show_auto_allocated_topology doesn't clean its resources:
- network: auto_allocated_network
- subnets: auto_allocated_subnet_v4 & auto_allocated_subnet_v6
- router: auto_allocated_router

This bug easily breaks testing in a quick run when allocating the
subnet due to insufficient prefix space to allocate subnet size /26.

https://build.opnfv.org/ci/job/functest-latest-daily/746/

Change-Id: I1a1bd22068bca0720016dab8a15ad7dd576ee152
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use alpine edge

Last upper-constraints updates force Alpine edge.
https://build.opnfv.org/ci/job/functest-core-docker-build-amd64-master/941/console

Change-Id: If2c7d434cfa45e676e3d236a2f59f916b43b5cd1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use default ssh_timeout (300) in Functest

196 is used in OpenStack gates but it doesn't fit the Functest model.
Functest runs all test cases in parallel vs the same SUT.

https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38

Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add tempest_cyborg in Functest ansible role

Change-Id: I58ae820e10af29be757616fb5faf716453169e25
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add tempest_cyborg based on cyborg tempest plugin

Change-Id: I61e982011040ee8b0540910939983777280445ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Cirros to O.5.1

It conforms to the OpenStack gates which have just updated to Cirros
0.5.1

Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update microversions (Train) in CNTT testing

Baraque selects Train:
https://github.com/cntt-n/CNTT/pull/1782
https://github.com/cntt-n/CNTT/pull/1783

Change-Id: Id9ee50133a3529e4c905b60f993762205178fe7c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enable back manage_snapshot testing in CNTT

Baraque selects Train:
https://github.com/cntt-n/CNTT/pull/1782
https://github.com/cntt-n/CNTT/pull/1783

Change-Id: Ie715a86cf6129ab5b51bf9e0ec07f326c0f86ccb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enable back RemoteStack testing from tempest_heat_cntt

Baraque selects Train:
https://github.com/cntt-n/CNTT/pull/1782
https://github.com/cntt-n/CNTT/pull/1783

Change-Id: I9650f5b9041a59b68af34c7410c64515e498a226
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Patrole tempest list if OVN

Change-Id: I66811c31fac4a83ed9634e928b9af8fa6e633034
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest blacklist if OVN

It takes into account last Patrole changes.

Change-Id: I552442864297b51a1cd7885b357b139b664e536a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove distlib from OpenStack constraints

It raised side effects wih Alpine [1].

[1] https://build.opnfv.org/ci/job/functest-core-docker-build-amd64-master/933/console

Change-Id: Ic922c2b56afe67f2f3e436c562c045f4d0fdbef4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reduce Patrole extra logic

It also reduces the skipped test list taking into account Patrole
improvements.

Change-Id: I23a8c0610a8a4258aa806451f52796f3e7bc46ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Avoid compiling numpy if arm

It reaches Travis-ci timeouts

Change-Id: I30405cc1cd603a9dee96674d350d04eeb39e6add
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Patrole user -> member

Change-Id: I050caff2d255118edff48403a87305cfe336e20a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Create all /etc dirs per service

Change-Id: I6bb0e68b817a3776e0ca051eea93b199db0bac1b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix tempest_scenario

It completes "min_computes_nodes is also used as max values".

Change-Id: I72c67e17015bc35ac5e14f20839cf74353695373
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Generate all policies for patrole

Change-Id: Ica6455e3467ef2695d489170bd8f94553a6fdf06
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

min_computes_nodes is also used as max values

Its max value is now 10 according to the default quota.

Change-Id: Ie7bfcb224e821c15d38d0cba1d9f080548613e79
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Prepare full patrole testing

It adds the remaining services which didn't work before.
It may be needed for CNTT (see security discussion in vevent).

Change-Id: I36b3ad8bbfc8ffdcc427c3d97b92c78da27915c0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add patrole user and reader testing

The regexes will be updated in a second change (chicken and egg
between Functest and Releng)

Change-Id: I4273a80799730fe30c941a7b2966cfee46f24d4a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_neutron_cntt regex and test count

It takes latest updates into account [1][2].

[1] http://artifacts.opnfv.org/functest/4W4YF3954M7H/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-85/tempest_neutron_cntt/tempest-report.html
[2] http://artifacts.opnfv.org/functest/K4DV91F2Y9V0/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-76/tempest_neutron_cntt/tempest-report.html

Change-Id: Ia9b57e708522926fde9f8c44e6a0e936e97f304f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Simplify hypervisor list logic in vmtp

It completes the previous change "Allow listing hypervisors in VMTP" [1].

[1] https://gerrit.opnfv.org/gerrit/c/functest/+/70359

Change-Id: I12a19fd473076cfc3262f096cac1615c183710b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove build data in CNTT playbook

It's useless from a CNTT point of view.
It remains in the classical IaaS verification to ease creating
Functest Jenkins Jobs.

Change-Id: Icb13ab7d0e43b4cf968cab4041b6827c11c20cbc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow listing hypervisors in VMTP

It allows listing the compute under tests via VMTP_HYPERVISORS.
They are no additional log in Functest and the note in VMTP is still
valid [1].

[1] https://opendev.org/x/vmtp/src/branch/master/vmtp/vmtp.py#L833

Change-Id: Ic9fbda3901d796c0ed94e42e2a14c468598f4311
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Increase timeout in shaker and vmtp

Running them in parallel of rally full and jobs asks for a increase.

Change-Id: Ib2369d384ac839fb46031411e1985ac402da0c1e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reuse OpenStack master upper-constaints.txt

https://github.com/openstack/requirements/commit/c2f72e26a42eceb4b64f80d04db8253a4fbdb793

Change-Id: I0318c8614b09dc7cff1ffba4b813e55483df7eb3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Stop leveraging on neutron plugins and extra

Neutron leverages on the upstream Rally task in Stein and newer.
Leveraging on the upstream task may fix the side effects which
sometimes occured on Vmtp and Shaker [1] and filled better the CNTT
model.

[1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/

Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Install py3-wheel to avoid legacy installation

Change-Id: I5cfd3e370ef16785eeceaafefa18b45d2221c04b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Compile lxml with optimization in smoke

Else cross compilation raises travis-ci.org's timeouts [1]

[1] https://travis-ci.org/github/collivier/functest/jobs/698227192

Change-Id: I985321ac68a7a94cb8483d831f03222d44b3be57
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>