Set of basic Functional tests to validate the OPNFV scenarios.
testcases:
-
- case_name: tempest_smoke
+ case_name: tempest_neutron
project_name: functest
criteria: 100
blocking: false
description: >-
- This test case runs the smoke subset of the OpenStack
- Tempest suite. The list of test cases is generated by
+ This test case runs the Tempest suite proposed by the
+ Neutron project. The list of test cases is generated by
Tempest automatically and depends on the parameters of
- the OpenStack deplopyment.
- https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L114
+ the OpenStack deployment.
run:
name: tempest_common
args:
- mode: '(?=.*\[.*\bsmoke\b.*\])(^tempest\.api)'
+ mode: '^neutron_tempest_plugin\.api'
option:
- '--concurrency=4'
-
- case_name: neutron-tempest-plugin-api
+ case_name: tempest_cinder
project_name: functest
criteria: 100
blocking: false
description: >-
This test case runs the Tempest suite proposed by the
- Neutron project. The list of test cases is generated by
- Tempest automatically and depends on the parameters of
- the OpenStack deployment.
+ Cinder project.
run:
name: tempest_common
args:
- mode: '^neutron_tempest_plugin\.api'
+ mode:
+ '(?!.*test_incremental_backup)(^cinder_tempest_plugin.)'
+ option:
+ - '--concurrency=4'
+
+ -
+ case_name: tempest_keystone
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the Tempest suite proposed by the
+ Keystone project.
+ run:
+ name: tempest_common
+ args:
+ mode: 'keystone_tempest_plugin.'
+ option:
+ - '--concurrency=4'
+
+ -
+ case_name: tempest_heat
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the Tempest suite proposed by the
+ Heat project.
+ run:
+ name: tempest_heat
+ args:
+ mode: '^heat_tempest_plugin.tests'
+ option:
+ - '--concurrency=1'
+
+ -
+ case_name: tempest_telemetry
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the Tempest suite proposed by the
+ Telemetry project.
+ run:
+ name: tempest_common
+ args:
+ mode: "(?!.*test_autoscaling)(?!.*test_live)\
+ (^telemetry_tempest_plugin)"
+ services:
+ - aodh
+ - gnocchi
+ - panko
option:
- '--concurrency=4'
Rally suite in smoke mode.
run:
name: rally_sanity
+ args:
+ optional:
+ - 'gnocchi'
+ - 'barbican'
-
- case_name: refstack_defcore
+ case_name: refstack_compute
project_name: functest
criteria: 100
blocking: false
+ deny_skipping: true
+ tests_count: 222
description: >-
This test case runs a sub group of tests of the OpenStack
- Defcore testcases.
+ Compute testcases.
run:
- name: refstack_defcore
+ name: refstack
args:
+ target: compute
option:
- '--concurrency=4'
-
- case_name: patrole
+ case_name: refstack_object
project_name: functest
criteria: 100
blocking: false
+ deny_skipping: true
+ tests_count: 58
description: >-
- Test suite from Patrole project.
+ This test case runs a sub group of tests of the OpenStack
+ Object testcases.
run:
- name: patrole
+ name: refstack
args:
- role: 'admin'
- includes:
- - 'image'
- - 'network'
- excludes:
- - 'test_networks_multiprovider_rbac'
+ target: object
+ option:
+ - '--concurrency=4'
-
- case_name: snaps_smoke
+ case_name: refstack_platform
project_name: functest
criteria: 100
blocking: false
+ deny_skipping: true
+ tests_count: 278
description: >-
- This test case contains tests that setup and destroy
- environments with VMs with and without Floating IPs
- with a newly created user and project. Set the config
- value snaps.use_floating_ips (True|False) to toggle
- this functionality. When the config value of
- snaps.use_keystone is True, functest must have access to
- the cloud's private network.
+ This test case runs a sub group of tests of the OpenStack
+ Platform testcases.
run:
- name: snaps_smoke
+ name: refstack
+ args:
+ target: platform
+ option:
+ - '--concurrency=4'
-
- case_name: neutron_trunk
+ case_name: tempest_full
project_name: functest
criteria: 100
blocking: false
description: >-
- This test case runs the neutron trunk subtest of the
- OpenStack Tempest suite. The list of test cases is
- generated by Tempest having as input the relevant
- testcase list file.
+ The list of test cases is generated by
+ Tempest automatically and depends on the parameters of
+ the OpenStack deployment.
+ https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
run:
name: tempest_common
args:
- mode: 'neutron_tempest_plugin.(api|scenario).test_trunk'
- neutron_extensions:
- - trunk
- - trunk-details
+ mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.api)'
+ option:
+ - '--concurrency=4'
-
- case_name: networking-bgpvpn
+ case_name: tempest_scenario
project_name: functest
criteria: 100
blocking: false
description: >-
- This test case runs OpenStack networking-bgpvpn Tempest
- suite. The list of test cases is generated by Tempest
- having as input the relevant regex.
+ The list of test cases is generated by
+ Tempest automatically and depends on the parameters of
+ the OpenStack deployment.
+ https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
run:
- name: tempest_common
+ name: tempest_scenario
args:
- mode: '^networking_bgpvpn_tempest\.'
- neutron_extensions:
- - bgpvpn
+ mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)'
option:
- - '--concurrency=4'
+ - '--concurrency=1'
-
- case_name: networking-sfc
+ case_name: tempest_slow
project_name: functest
criteria: 100
blocking: false
description: >-
- This test case runs OpenStack networking-sfc Tempest
- suite. The list of test cases is generated by Tempest
- having as input the relevant regex.
+ The list of test cases is generated by
+ Tempest automatically and depends on the parameters of
+ the OpenStack deployment.
+ https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
run:
name: tempest_common
args:
- mode:
- '^(?:networking_sfc\.tests\.tempest_plugin.tests.api).*$'
- neutron_extensions:
- - sfc
+ mode: '(?=.*\[.*\bslow\b.*\])(^tempest\.)'
option:
- - '--concurrency=0'
+ - '--concurrency=1'
-
- case_name: barbican
+ case_name: patrole_admin
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ Test suite from Patrole project.
+ run:
+ name: patrole
+ args:
+ role: 'admin'
+ includes:
+ - 'image'
+ - 'network'
+ excludes:
+ - 'network.test_flavors_rbac'
+ - 'network.test_network_ip_availability_rbac'
+ - 'test_networks_multiprovider_rbac'
+ - 'test_auto_allocated_topology_rbac'
+ - 'test_create_network_provider_segmentation_id'
+ - 'test_update_network_provider_physical_network'
+ - 'test_update_network_provider_segmentation_id'
+ - 'network.test_agents_rbac'
+ - 'test_list_metadef_namespaces'
+
+ -
+ case_name: patrole_user
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ Test suite from Patrole project.
+ run:
+ name: patrole
+ args:
+ role: 'user'
+ includes:
+ - 'image'
+ - 'network'
+ excludes:
+ - 'network.test_flavors_rbac'
+ - 'network.test_network_ip_availability_rbac'
+ - 'test_networks_multiprovider_rbac'
+ - 'test_auto_allocated_topology_rbac'
+ - 'test_create_network_provider_segmentation_id'
+ - 'test_update_network_provider_physical_network'
+ - 'test_update_network_provider_segmentation_id'
+ - 'network.test_agents_rbac'
+ - 'test_list_metadef_namespaces'
+
+ -
+ case_name: patrole_reader
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ Test suite from Patrole project.
+ run:
+ name: patrole
+ args:
+ role: 'reader'
+ includes:
+ - 'image'
+ - 'network'
+ excludes:
+ - 'network.test_flavors_rbac'
+ - 'network.test_network_ip_availability_rbac'
+ - 'test_networks_multiprovider_rbac'
+ - 'test_auto_allocated_topology_rbac'
+ - 'test_create_network_provider_segmentation_id'
+ - 'test_update_network_provider_physical_network'
+ - 'test_update_network_provider_segmentation_id'
+ - 'network.test_agents_rbac'
+ - 'test_list_metadef_namespaces'
+
+ -
+ case_name: tempest_barbican
project_name: functest
criteria: 100
blocking: false
'^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$'
services:
- barbican
+ option:
+ - '--concurrency=4'
+
+ -
+ case_name: tempest_octavia
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ It leverages on the tempest plugin containing tests used to
+ verify the functionality of an octavia installation.
+ run:
+ name: tempest_common
+ args:
+ mode: "(?!.*api.v2.test_availability_zone)\
+ (?!.*api.v2.test_availability_zone_profile)\
+ (?!.*api.v2.test_member.MemberAPITest.test_member_ipv4_create)\
+ (?!.*api.v2.test_member.MemberAPITest.test_member_ipv6_create)\
+ (^octavia_tempest_plugin.tests.(api|scenario))"
+ services:
+ - octavia
+ option:
+ - '--concurrency=2'
Code Review / functest.git / blobdiff