Split Gates in a dedicated site.yml

Change-Id: If470f70359442fabba6c5064f65aff972597131e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_custom in userguide

It was mostly only used by OVP (Functest leverages regexes).
It's now up-to-date about stevedore.

Functest users are free to overwrite any refstack list (e.g.
/home/opnfv/functest/data/refstack/platform.txt) if they want the same
behavior [1].

[1] https://git.opnfv.org/functest/tree/docker/smoke/platform.txt

Co-Authored-By: Roman Kuzmin <rkuzmin@mirantis.com>
Change-Id: I2b6c3ceda102319bfea810ab2a7bf2d911e20f6b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Publish "Orange CNTT RC1 Field Trial"

It will be introduced during LFN Dev event.

Change-Id: I9e0a048464a8fd99131cccf2741135aacf7e839d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Publish presentation "OPNFV/CNTT in Orange RFP"

It was introduced during ONES NA 2020 [1][2].

[1] http://testresults.opnfv.org/functest/rfp/
[2] http://testresults.opnfv.org/functest/ONES2020NA_OPNFV-CNTT_RFP.1080p.mp4

Change-Id: I7accf164907d04c56470fbf83fe28363b84ac1bf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update results in docs

It takes into account cybort and new patrole testing.

Change-Id: I96ef84c32f792d162bf05399229ba1c4ca7600a8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Swith to active abot_charm repo

We keep syncing both repos but it helps quickly integrating patches.

Change-Id: Ia6f05994d209e60d1278b7a033317bf7e17e22c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Modify smoke and benchmarking in Docker From

Change-Id: I0d7acd82f3a4305e862e924d1199c5d28d3ccf56
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enable back Patrole volume testing

It skips test_create_network_provider_segmentation_id
as it can run in parallel (200 is hardcoded) and
test_create_image_from_volume_backed_server which
doesn't clean its resources.

Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add helm_vims in release notes and console outputs

Change-Id: Iaf8d09046471e4508660ebd34f34278683a449c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update kube_bench split in doc

Change-Id: Id4d934f0330bd3338498435a884e33df12850c64
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_neutron test_count to 523

http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html

Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip patrole volume testing

They don't clean volume and snapshot which raises side effects after
lots of iterations. They may be obsolete too [1]

[1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html

Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip test_backup_crossproject_*_negative

They are currently failing and they don't seem executed in gates [1].

[1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html

Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Functest Kubernetes outputs

Change-Id: I314e232838204f1fb1595cf884957cdf77969615
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove build date which fails spellcheck

https://travis-ci.org/github/collivier/functest/jobs/724612517

Change-Id: Iee849b624870a8106de0167f30bc1e31d47f1f13
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Xtesting to 0.91.0

Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip obsolete Patrole tests

Details: Policy action "os_compute_api:os-floating-ips" not found in policy files: [] or among registered policy in code defaults for nova service.

http://artifacts.opnfv.org/functest/OTNURZ1MTVG3/functest-opnfv-functest-smoke-latest-patrole_reader-run-86/patrole_reader/tempest-report.html

Change-Id: I678b3c10d19006d9ed978c8fa1d9eed933012b84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix functest/ci/testcases.yaml

Even if it's unused, it's keep synced by docker files.

Change-Id: Ia98164c361017392542073745c37b441ec2216d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_full_cntt regexes

http://artifacts.opnfv.org/functest/VX7Y4UA8F07W/functest-pi-ollivier-functest-smoke-cntt-latest-tempest_full_cntt-run-2/tempest_full_cntt/tempest-report.html
https://review.opendev.org/#/c/737634/

Change-Id: I31ea1f30c06cf9cc8c44933a4f1db954db037c53
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update K8s test case results in doc

Change-Id: I655629f539af63deccd6a9c6ad1fb7600f4bde60
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Delete vgpu testcase

It's not longer executed and offered in any Functest container.

Change-Id: I9805eca1e0d7203fecc396398469bccc38458888
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use lower bound for py3-distlib version

Change-Id: I3a97b0cb5fb9c75e7e675370c656325d4c536e8b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Boot a VM to run juju

It allows running juju_epc vs arm32 and arm64.
It stops offering juju in functest-vnf and rather installs it in a VM.

It also adds a couple of missing output decode()

Change-Id: I2218742b2824c8328823051bde32422e56784e90
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Only upgrade py3-distlib"

Only upgrade py3-distlib

https://travis-ci.org/github/collivier/functest/jobs/715442363

Change-Id: Ie34cae67df56b23581e90488c5fa70757efc4b61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Use alpine edge for py3-distlib only"

Use alpine edge for py3-distlib only

Alpine 3.12 doesn't offer a version compatible with latest OpenStack
constraints. It may fix all issues when compiling Functest for arm [1].

[1] https://travis-ci.org/github/collivier/functest/jobs/715229717

Change-Id: I7f55cafff2c7a34909440c5ca1d1f641194761c9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Updated from global requirements

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ibcac0888c7b62d6f59cea7dea021cf64610d38c1

Update docs links

It takes into account Bitergia EOL.

Change-Id: Iaf1292a9b1af8a953ae731037be1954b6c8d5966
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reduce ImportImagesTest regex

It fits last change in ImportImagesTest [1].

[1] http://artifacts.opnfv.org/functest/7WDODZD71WX9/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-159/tempest_full_cntt/tempest-report.html

Change-Id: Ic4e3ca5d0c83696be75b97edb09c4d9a2be7ab30
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Conform with git format-patch for last tempest patch

The patch name must conform with the last commit update.

Change-Id: I493582d41080bd5d8b70d751b68af36ae61bcdc9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Revert ssh_timeout to 196 in Functest

The race condition has been fixed [1] and we can try the timeout used
in OpenStack gates.

[1] https://gerrit.opnfv.org/gerrit/c/functest/+/70606

Change-Id: Iaf8b260c743c1fd0088d31060a43b1788545743c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Increase check_console_loop to 12

It failed once when deeply testing in parallel [1].

https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-jerma-vyos_vrouter-run/80/console

Change-Id: Ia70c43d603302d1bed46d984541b0e71461be4c4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_cinder_cntt test_counts to 11

http://artifacts.opnfv.org/functest/81YZ7LMI0PUW/functest-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-149/tempest_cinder_cntt/tempest-report.html

Change-Id: Ibe7c5ce70262c6fb604bab05038fbd6c408d23f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Apply new Create-new-server-test_reboot_server_hard.patch

test_reboot_server_hard sometimes fail in all gates [1].
This hack could highlight if they are side effects between
test_create_backup and test_reboot_server_hard.

[1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html

Change-Id: I230a6faa4b619e71646a312500ee38a3a8b1093c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip ImportImagesTest.test_image_import in CNTT

ImportImagesTest skipped as image import is not available [1]

[1] http://artifacts.opnfv.org/functest/S9ABQ628T5IG/functest-opnfv-functest-smoke-latest-tempest_full-run-850/tempest_full/tempest-report.html

Change-Id: I1999ed96f546ac7bf2115d205382b3b7f4dfe9af
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add nics net-id when booting dd load test

http://artifacts.opnfv.org/functest/EP1852KPIZEE/functest-opnfv-functest-smoke-latest-rally_sanity-run-920/rally_sanity/rally_sanity.html#/VMTasks.dd_load_test/failures

Change-Id: I959d414692dd52e76175a7341f7d16ef28ab8472
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Print data to debug ServerActionsTestJSON.test_reboot_server_hard

Change-Id: Ib3142be2d6f04315c51831d06e35cc086223603e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Create new server test_reboot_server_hard

It sometimes fail in all gates [1]
This hack could highlight if it's a timeout issue or race conditions
between all tempest tests.

[1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html

Change-Id: I8d03aa10c3d822dacb983e5ca019f79e1c582c9e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rename ext_network to floating_network in Rally tasks

http://artifacts.opnfv.org/functest/TCEP6YYTDWIG/functest-opnfv-functest-benchmarking-latest-rally_full-run-181/rally_full/rally_full.html#/NovaServers.boot_and_associate_floating_ip

Change-Id: I45d666e80a55802ab6c672dfb5f3cf93dc5381bb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Increate neutron_tempest count to 517

http://artifacts.opnfv.org/functest/UM6QD3YXHAAC/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-104/tempest_neutron_cntt/tempest-report.html

Change-Id: If7df0bcd08629ffca60fcb20eb45847199b28e0c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add VMTasks.dd_load_test in Rally test cases

It allows running dd in VM (simple disk benchmarking).

https://github.com/cntt-n/CNTT/issues/1477

Change-Id: I4f1150637460f6e0b661fc80fec2cc292efcc511
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rename ext_network to floating_network in Rally tasks

It now fails [1]:
Traceback (most recent call last):
  File "/src/rally/rally/task/runner.py", line 70, in _run_scenario_once
    getattr(scenario_inst, method_name)(**scenario_kwargs)
  File "/usr/lib/python3.8/site-packages/rally_openstack/task/scenarios/nova/servers.py", line 1115, in run
    floatingip = self.neutron.create_floatingip(**create_floating_ip_args)
  File "/src/rally/rally/task/service.py", line 114, in wrapper
    return func(instance, *args, **kwargs)
  File "/src/rally/rally/task/atomic.py", line 91, in func_atomic_actions
    f = func(self, *args, **kwargs)
TypeError: create_floatingip() got an unexpected keyword argument 'ext_network'

[1] http://artifacts.opnfv.org/functest/JOGVTC31O1IL/functest-opnfv-functest-smoke-latest-rally_sanity-run-905/rally_sanity/rally_sanity.html#/NovaServers.boot_server_associate_and_dissociate_floating_ip/failures

Change-Id: I7157847980b417b814d15e4bf3bbac3c4f114690
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add Patrole compute testing

It stops leveraging on policy json files as it fails for Nova.

Change-Id: Ic70997d0ff8151956dc189739b8468def048aad7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip Patrole test_show_auto_allocated_topology

test_show_auto_allocated_topology doesn't clean its resources:
- network: auto_allocated_network
- subnets: auto_allocated_subnet_v4 & auto_allocated_subnet_v6
- router: auto_allocated_router

This bug easily breaks testing in a quick run when allocating the
subnet due to insufficient prefix space to allocate subnet size /26.

https://build.opnfv.org/ci/job/functest-latest-daily/746/

Change-Id: I1a1bd22068bca0720016dab8a15ad7dd576ee152
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use alpine edge

Last upper-constraints updates force Alpine edge.
https://build.opnfv.org/ci/job/functest-core-docker-build-amd64-master/941/console

Change-Id: If2c7d434cfa45e676e3d236a2f59f916b43b5cd1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use default ssh_timeout (300) in Functest

196 is used in OpenStack gates but it doesn't fit the Functest model.
Functest runs all test cases in parallel vs the same SUT.

https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38

Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add tempest_cyborg in Functest ansible role

Change-Id: I58ae820e10af29be757616fb5faf716453169e25
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add tempest_cyborg based on cyborg tempest plugin

Change-Id: I61e982011040ee8b0540910939983777280445ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Cirros to O.5.1

It conforms to the OpenStack gates which have just updated to Cirros
0.5.1

Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update microversions (Train) in CNTT testing

Baraque selects Train:
https://github.com/cntt-n/CNTT/pull/1782
https://github.com/cntt-n/CNTT/pull/1783

Change-Id: Id9ee50133a3529e4c905b60f993762205178fe7c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enable back manage_snapshot testing in CNTT

Baraque selects Train:
https://github.com/cntt-n/CNTT/pull/1782
https://github.com/cntt-n/CNTT/pull/1783

Change-Id: Ie715a86cf6129ab5b51bf9e0ec07f326c0f86ccb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enable back RemoteStack testing from tempest_heat_cntt

Baraque selects Train:
https://github.com/cntt-n/CNTT/pull/1782
https://github.com/cntt-n/CNTT/pull/1783

Change-Id: I9650f5b9041a59b68af34c7410c64515e498a226
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Patrole tempest list if OVN

Change-Id: I66811c31fac4a83ed9634e928b9af8fa6e633034
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest blacklist if OVN

It takes into account last Patrole changes.

Change-Id: I552442864297b51a1cd7885b357b139b664e536a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove distlib from OpenStack constraints

It raised side effects wih Alpine [1].

[1] https://build.opnfv.org/ci/job/functest-core-docker-build-amd64-master/933/console

Change-Id: Ic922c2b56afe67f2f3e436c562c045f4d0fdbef4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reduce Patrole extra logic

It also reduces the skipped test list taking into account Patrole
improvements.

Change-Id: I23a8c0610a8a4258aa806451f52796f3e7bc46ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Avoid compiling numpy if arm

It reaches Travis-ci timeouts

Change-Id: I30405cc1cd603a9dee96674d350d04eeb39e6add
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Patrole user -> member

Change-Id: I050caff2d255118edff48403a87305cfe336e20a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Create all /etc dirs per service

Change-Id: I6bb0e68b817a3776e0ca051eea93b199db0bac1b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix tempest_scenario

It completes "min_computes_nodes is also used as max values".

Change-Id: I72c67e17015bc35ac5e14f20839cf74353695373
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Generate all policies for patrole

Change-Id: Ica6455e3467ef2695d489170bd8f94553a6fdf06
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

min_computes_nodes is also used as max values

Its max value is now 10 according to the default quota.

Change-Id: Ie7bfcb224e821c15d38d0cba1d9f080548613e79
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Prepare full patrole testing

It adds the remaining services which didn't work before.
It may be needed for CNTT (see security discussion in vevent).

Change-Id: I36b3ad8bbfc8ffdcc427c3d97b92c78da27915c0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add patrole user and reader testing

The regexes will be updated in a second change (chicken and egg
between Functest and Releng)

Change-Id: I4273a80799730fe30c941a7b2966cfee46f24d4a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tempest_neutron_cntt regex and test count

It takes latest updates into account [1][2].

[1] http://artifacts.opnfv.org/functest/4W4YF3954M7H/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-85/tempest_neutron_cntt/tempest-report.html
[2] http://artifacts.opnfv.org/functest/K4DV91F2Y9V0/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-76/tempest_neutron_cntt/tempest-report.html

Change-Id: Ia9b57e708522926fde9f8c44e6a0e936e97f304f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Simplify hypervisor list logic in vmtp

It completes the previous change "Allow listing hypervisors in VMTP" [1].

[1] https://gerrit.opnfv.org/gerrit/c/functest/+/70359

Change-Id: I12a19fd473076cfc3262f096cac1615c183710b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove build data in CNTT playbook

It's useless from a CNTT point of view.
It remains in the classical IaaS verification to ease creating
Functest Jenkins Jobs.

Change-Id: Icb13ab7d0e43b4cf968cab4041b6827c11c20cbc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow listing hypervisors in VMTP

It allows listing the compute under tests via VMTP_HYPERVISORS.
They are no additional log in Functest and the note in VMTP is still
valid [1].

[1] https://opendev.org/x/vmtp/src/branch/master/vmtp/vmtp.py#L833

Change-Id: Ic9fbda3901d796c0ed94e42e2a14c468598f4311
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Increase timeout in shaker and vmtp

Running them in parallel of rally full and jobs asks for a increase.

Change-Id: Ib2369d384ac839fb46031411e1985ac402da0c1e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reuse OpenStack master upper-constaints.txt

https://github.com/openstack/requirements/commit/c2f72e26a42eceb4b64f80d04db8253a4fbdb793

Change-Id: I0318c8614b09dc7cff1ffba4b813e55483df7eb3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Stop leveraging on neutron plugins and extra

Neutron leverages on the upstream Rally task in Stein and newer.
Leveraging on the upstream task may fix the side effects which
sometimes occured on Vmtp and Shaker [1] and filled better the CNTT
model.

[1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/

Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Install py3-wheel to avoid legacy installation

Change-Id: I5cfd3e370ef16785eeceaafefa18b45d2221c04b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Compile lxml with optimization in smoke

Else cross compilation raises travis-ci.org's timeouts [1]

[1] https://travis-ci.org/github/collivier/functest/jobs/698227192

Change-Id: I985321ac68a7a94cb8483d831f03222d44b3be57
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Clone repositories instead of wgetting constraints

It stops leveraging on wget to get constraints as it fails since
opendev was created. Then functest and requirements are no longer
removed for functest-core which simplifies all child Dockerfile.

It also fix the current incompatibilities in OpenStack constraints
ERROR: cliff 3.2.0 has requirement cmd2!=0.8.3,<0.9.0,>=0.8.0, but you'll have cmd2 1.1.0 which is incompatible.
https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L230
https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L416

Change-Id: I7c044208ef26ad047fb841710b422acb6c9f0320
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip EncryptionVolTypeTest in Iaas verification and CNTT Conformance

Attaching an encryted volume is optional in CNTT [1].

This test fails if the volume type already exists and if it runs
twice in parallel [2]. As this single test doesn't fullfil the Functest
requirements, it's skiped in the classical verification as well.

[1] https://github.com/cntt-n/CNTT/blob/master/doc/ref_arch/openstack/chapters/chapter05.md
[2] https://storyboard.openstack.org/#!/story/2007804

Change-Id: Ib6fc843d71704aab1bfc536133544eb3fa4f3e72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove RemoteStack testing from tempest_heat_cntt

Trusts redelegation is supported by Train [1][2] which forces to skip
RemoteStack as CNTT Baldy is designed for Pike (the support is
incomplete in case of trust [3]).

[1] https://docs.openstack.org/releasenotes/heat/train.html#relnotes-13-0-0-stable-train
[2] https://github.com/openstack/heat/commit/e377658586c737150dad1bfd80b7b2267d46be51
[3] https://bugs.launchpad.net/heat/+bug/1701498

Change-Id: Ib4f66170b9b1f50b8224705edb4820e5a4cb0167
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add missing tempest_octavia in patches

Change-Id: I0fae7487955895bf8f41046043425849f8fd0bf2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update all patches proposed by Functest

It mostly takes into account the last changes in test case names and
new cntt-related test cases.

Change-Id: I271fd02095b57f3b19b5ff95299fb4b257163c1f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update aarch64 configs

Change-Id: Ib53b9f97f30bf86d33857910ab9bffa1ce0d1e9e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Update functest/ci/testcases.yaml"

Merge "Stop increase thread stack size"

Update functest/ci/testcases.yaml

It takes all CNTT changes into account.

Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Stop increase thread stack size

It seems useless and then it limits the diff to Rally.

Change-Id: Ib745c7aad20ab5ab7fd4f8a5c7deb9d4aff30881
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to alpine3.12

https://alpinelinux.org/posts/Alpine-3.12.0-released.html

Change-Id: Ie7c72abd10d70b90d65f260d595c0ca47b69a8c0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Increase tempest_neutron's tests_count

http://artifacts.opnfv.org/functest/Q3047D5AS3HJ/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-40/tempest_neutron_cntt/tempest-report.html
http://artifacts.opnfv.org/functest/03PRDE6TZC14/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-49/tempest_neutron_cntt/tempest-report.html

Change-Id: I4be6d2f58e50572a3e8b90ede0055f36bc1d6886
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Switch back to concurrency = 4 in tempest testcases

3 seems good enough and stable which allows trying 4 as before

Change-Id: Id1f17ebf73f9faa13ed3ceb327ccb4ecf88c2bf2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Run VNF in parallel in Functest default playbook

They pass in parallel if the bandwidth is good enough.
https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/679/

Change-Id: I2f466f7f25898d8af3004da1d3ef2208e4410f7c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rename patch name and removes debug logs

The debug logs works only vs py3.8 and breaks backport to Iruya.

Change-Id: Ie91a8a876e263a83b6ae3fbfb5bb05644b87b970
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Switching to Threading instead of multiprocessing

Change-Id: Id5059a06447357f4c9b058bad374ed6cbe4d742c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Increase tests_count into tempest_neutron_cntt

http://artifacts.opnfv.org/functest/KJSOWXFF5CIQ/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-41/tempest_neutron_cntt/tempest-report.html

Change-Id: I04f0c3ae695f17e2bd56add11410e24ee25967d2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Switch to queue.Queue() in Rally

It's still failing.

Change-Id: I20fdf5a8e05bccc30a760934f6c0e3cac16d763c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Switch to SimpleQueue()

Change-Id: I1f3cb636813b9c3c10b5c829e35bbdeea02a318c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Switch to fork in Python multiprocessing (python2 default)

Change-Id: Id93da8c0fc710e1491adeb2b42e6da99974a0580
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Take last upstream changes into account in the regexes

http://artifacts.opnfv.org/functest/1NCC8YUFKE7X/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-64/tempest_slow_cntt/tempest-report.html

Change-Id: I196421d96ada3ec1eb8fc718f72c3e796a0bd3b4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Retry increasing Stack size

Change-Id: I61cb70a74179dea6a02e81989695325fe6331e10
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip manage_snapshot in CNTT

As detected by Orange's RC Field trial, Ceph doesn't support this
feature before Rocky [1].
"AttributeError: 'RBDDriver' object has no attribute 'unmanage_snapshot'"

manage_snapshot testing is fully passing in Functest SUT because CNTT
is verified vs OpenStack Rocky and newer.

Ceph is selected by RI as backend and is widely reused by the ecosytem.
It's similar to [2].

[1] https://bugs.launchpad.net/cinder/+bug/1645288
[2] https://gerrit.opnfv.org/gerrit/c/functest/+/69888

Change-Id: I3b7f88f5bed9a47a1e26e16bbbf74fea24ca76c2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove test_gnocchi.GnocchiGabbiTest.test_live

It sometimes fails in our gates and it seems unverified in OpenStack [1].
"Archive policy gabbilive is still in use"

[1] http://artifacts.opnfv.org/functest/DET32CBF0L0F/functest-opnfv-functest-smoke-jerma-tempest_telemetry-run-29/tempest_telemetry/tempest-report.html

Change-Id: Id5e5ad5ff0f7bade7932a085df28cc35b0ac7984
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update tests_count in tempest_full_cntt

http://artifacts.opnfv.org/functest/R1927JRCFJR5/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-62/tempest_full_cntt/tempest-report.html

Change-Id: Ia4b5bbdb92e7877d81acdcf9c4f3a9745badfb36
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Precise validation configs in Neutron

ServerActionsTestJSON.test_reboot_server_hard [1] sometimes fails in
gates. We may increase timeouts if it stills fails.

[1] http://artifacts.opnfv.org/functest/LIQH38CPR30X/functest-opnfv-functest-smoke-hunter-tempest_full-run-649/tempest_full/tempest-report.html

Change-Id: Ia27c0faead1df5c2b33a3e1a272e5a1010a5a83e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7ccc1b0793e32cad3912e63bbca971d5c3ecd724)