Set of basic Functional tests to validate the OPNFV scenarios.
testcases:
-
- case_name: neutron-tempest-plugin-api
+ case_name: tempest_neutron
project_name: functest
criteria: 100
blocking: false
option:
- '--concurrency=4'
+ -
+ case_name: tempest_cinder
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the Tempest suite proposed by the
+ Cinder project.
+ run:
+ name: tempest_common
+ args:
+ mode:
+ '(?!.*test_incremental_backup)(^cinder_tempest_plugin.)'
+ option:
+ - '--concurrency=4'
+
+ -
+ case_name: tempest_keystone
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the Tempest suite proposed by the
+ Keystone project.
+ run:
+ name: tempest_common
+ args:
+ mode: 'keystone_tempest_plugin.'
+ option:
+ - '--concurrency=4'
+
+ -
+ case_name: tempest_heat
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the Tempest suite proposed by the
+ Heat project.
+ run:
+ name: tempest_heat
+ args:
+ mode: '^heat_tempest_plugin.tests'
+ option:
+ - '--concurrency=1'
+
+ -
+ case_name: tempest_telemetry
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the Tempest suite proposed by the
+ Telemetry project.
+ run:
+ name: tempest_common
+ args:
+ mode: "(?!.*test_autoscaling)(?!.*test_live)\
+ (^telemetry_tempest_plugin)"
+ services:
+ - aodh
+ - gnocchi
+ - panko
+ option:
+ - '--concurrency=4'
+
-
case_name: rally_sanity
project_name: functest
args:
optional:
- 'gnocchi'
+ - 'barbican'
-
- case_name: rally_jobs
+ case_name: refstack_compute
project_name: functest
criteria: 100
blocking: false
+ deny_skipping: true
+ tests_count: 222
description: >-
- This test case runs a group of Rally jobs used in
- OpenStack gating
+ This test case runs a sub group of tests of the OpenStack
+ Compute testcases.
run:
- name: rally_jobs
+ name: refstack
args:
- optional:
- - 'gnocchi'
+ target: compute
+ option:
+ - '--concurrency=4'
-
- case_name: refstack_defcore
+ case_name: refstack_object
project_name: functest
criteria: 100
blocking: false
+ deny_skipping: true
+ tests_count: 58
description: >-
This test case runs a sub group of tests of the OpenStack
- Defcore testcases.
+ Object testcases.
run:
- name: refstack_defcore
+ name: refstack
args:
+ target: object
+ option:
+ - '--concurrency=4'
+
+ -
+ case_name: refstack_platform
+ project_name: functest
+ criteria: 100
+ blocking: false
+ deny_skipping: true
+ tests_count: 278
+ description: >-
+ This test case runs a sub group of tests of the OpenStack
+ Platform testcases.
+ run:
+ name: refstack
+ args:
+ target: platform
option:
- '--concurrency=4'
the OpenStack deployment.
https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
run:
- name: tempest_common
+ name: tempest_scenario
args:
mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)'
option:
- '--concurrency=1'
-
- case_name: patrole
+ case_name: tempest_slow
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ The list of test cases is generated by
+ Tempest automatically and depends on the parameters of
+ the OpenStack deployment.
+ https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
+ run:
+ name: tempest_common
+ args:
+ mode: '(?=.*\[.*\bslow\b.*\])(^tempest\.)'
+ option:
+ - '--concurrency=1'
+
+ -
+ case_name: patrole_admin
project_name: functest
criteria: 100
blocking: false
- 'network.test_network_ip_availability_rbac'
- 'test_networks_multiprovider_rbac'
- 'test_auto_allocated_topology_rbac'
+ - 'test_create_network_provider_segmentation_id'
+ - 'test_update_network_provider_physical_network'
+ - 'test_update_network_provider_segmentation_id'
+ - 'network.test_agents_rbac'
+ - 'test_list_metadef_namespaces'
-
- case_name: snaps_smoke
- project_name: functest
- criteria: 100
- blocking: false
- description: >-
- This test case contains tests that setup and destroy
- environments with VMs with and without Floating IPs
- with a newly created user and project. Set the config
- value snaps.use_floating_ips (True|False) to toggle
- this functionality. When the config value of
- snaps.use_keystone is True, functest must have access to
- the cloud's private network.
- run:
- name: snaps_smoke
-
- -
- case_name: neutron_trunk
+ case_name: patrole_user
project_name: functest
criteria: 100
blocking: false
description: >-
- This test case runs the neutron trunk subtest of the
- OpenStack Tempest suite. The list of test cases is
- generated by Tempest having as input the relevant
- testcase list file.
+ Test suite from Patrole project.
run:
- name: tempest_common
+ name: patrole
args:
- mode: 'neutron_tempest_plugin.(api|scenario).test_trunk'
- neutron_extensions:
- - trunk
- - trunk-details
+ role: 'user'
+ includes:
+ - 'image'
+ - 'network'
+ excludes:
+ - 'network.test_flavors_rbac'
+ - 'network.test_network_ip_availability_rbac'
+ - 'test_networks_multiprovider_rbac'
+ - 'test_auto_allocated_topology_rbac'
+ - 'test_create_network_provider_segmentation_id'
+ - 'test_update_network_provider_physical_network'
+ - 'test_update_network_provider_segmentation_id'
+ - 'network.test_agents_rbac'
+ - 'test_list_metadef_namespaces'
-
- case_name: networking-bgpvpn
+ case_name: patrole_reader
project_name: functest
criteria: 100
blocking: false
description: >-
- This test case runs OpenStack networking-bgpvpn Tempest
- suite. The list of test cases is generated by Tempest
- having as input the relevant regex.
+ Test suite from Patrole project.
run:
- name: tempest_common
+ name: patrole
args:
- mode: '^networking_bgpvpn_tempest\.'
- neutron_extensions:
- - bgpvpn
- option:
- - '--concurrency=4'
+ role: 'reader'
+ includes:
+ - 'image'
+ - 'network'
+ excludes:
+ - 'network.test_flavors_rbac'
+ - 'network.test_network_ip_availability_rbac'
+ - 'test_networks_multiprovider_rbac'
+ - 'test_auto_allocated_topology_rbac'
+ - 'test_create_network_provider_segmentation_id'
+ - 'test_update_network_provider_physical_network'
+ - 'test_update_network_provider_segmentation_id'
+ - 'network.test_agents_rbac'
+ - 'test_list_metadef_namespaces'
-
- case_name: networking-sfc
+ case_name: tempest_barbican
project_name: functest
criteria: 100
blocking: false
description: >-
- This test case runs OpenStack networking-sfc Tempest
- suite. The list of test cases is generated by Tempest
- having as input the relevant regex.
+ It leverages on the tempest plugin containing tests used to
+ verify the functionality of a barbican installation.
run:
- name: tempest_common
+ name: barbican
args:
mode:
- '^(?:networking_sfc\.tests\.tempest_plugin.tests.api).*$'
- neutron_extensions:
- - sfc
+ '^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$'
+ services:
+ - barbican
option:
- - '--concurrency=0'
+ - '--concurrency=4'
-
- case_name: barbican
+ case_name: tempest_octavia
project_name: functest
criteria: 100
blocking: false
description: >-
It leverages on the tempest plugin containing tests used to
- verify the functionality of a barbican installation.
+ verify the functionality of an octavia installation.
run:
- name: barbican
+ name: tempest_common
args:
- mode:
- '^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$'
+ mode: "(?!.*api.v2.test_availability_zone)\
+ (?!.*api.v2.test_availability_zone_profile)\
+ (?!.*api.v2.test_member.MemberAPITest.test_member_ipv4_create)\
+ (?!.*api.v2.test_member.MemberAPITest.test_member_ipv6_create)\
+ (^octavia_tempest_plugin.tests.(api|scenario))"
services:
- - barbican
+ - octavia
+ option:
+ - '--concurrency=2'
Code Review / functest.git / blobdiff