-
name: smoke
order: 1
- ci_loop: '(daily)|(weekly)'
description: >-
Set of basic Functional tests to validate the OPNFV scenarios.
testcases:
-
- case_name: tempest_smoke_serial
+ case_name: tempest_neutron
project_name: functest
criteria: 100
blocking: false
description: >-
- This test case runs the smoke subset of the OpenStack
- Tempest suite. The list of test cases is generated by
+ This test case runs the Tempest suite proposed by the
+ Neutron project. The list of test cases is generated by
Tempest automatically and depends on the parameters of
- the OpenStack deplopyment.
- dependencies:
- installer: ''
- scenario: ''
+ the OpenStack deployment.
run:
- module: 'functest.opnfv_tests.openstack.tempest.tempest'
- class: 'TempestSmokeSerial'
+ name: tempest_common
+ args:
+ mode: '^neutron_tempest_plugin\.api'
+ option:
+ - '--concurrency=4'
+
+ -
+ case_name: tempest_cinder
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the Tempest suite proposed by the
+ Cinder project.
+ run:
+ name: tempest_common
+ args:
+ mode:
+ '(?!.*test_incremental_backup)(^cinder_tempest_plugin.)'
+ option:
+ - '--concurrency=4'
+
+ -
+ case_name: tempest_keystone
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the Tempest suite proposed by the
+ Keystone project.
+ run:
+ name: tempest_common
+ args:
+ mode: 'keystone_tempest_plugin.'
+ option:
+ - '--concurrency=4'
+
+ -
+ case_name: tempest_heat
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the Tempest suite proposed by the
+ Heat project.
+ run:
+ name: tempest_heat
+ args:
+ mode: '^heat_tempest_plugin.tests'
+ option:
+ - '--concurrency=1'
+
+ -
+ case_name: tempest_telemetry
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the Tempest suite proposed by the
+ Telemetry project.
+ run:
+ name: tempest_common
+ args:
+ mode: "(?!.*test_autoscaling)(?!.*test_live)\
+ (^telemetry_tempest_plugin)"
+ services:
+ - aodh
+ - gnocchi
+ - panko
+ option:
+ - '--concurrency=4'
-
case_name: rally_sanity
description: >-
This test case runs a sub group of tests of the OpenStack
Rally suite in smoke mode.
- dependencies:
- installer: ''
- scenario: ''
run:
- module: 'functest.opnfv_tests.openstack.rally.rally'
- class: 'RallySanity'
+ name: rally_sanity
+ args:
+ optional:
+ - 'gnocchi'
+ - 'barbican'
+
+ -
+ case_name: refstack_compute
+ project_name: functest
+ criteria: 100
+ blocking: false
+ deny_skipping: true
+ tests_count: 222
+ description: >-
+ This test case runs a sub group of tests of the OpenStack
+ Compute testcases.
+ run:
+ name: refstack
+ args:
+ target: compute
+ option:
+ - '--concurrency=4'
+
+ -
+ case_name: refstack_object
+ project_name: functest
+ criteria: 100
+ blocking: false
+ deny_skipping: true
+ tests_count: 58
+ description: >-
+ This test case runs a sub group of tests of the OpenStack
+ Object testcases.
+ run:
+ name: refstack
+ args:
+ target: object
+ option:
+ - '--concurrency=4'
-
- case_name: refstack_defcore
+ case_name: refstack_platform
project_name: functest
- enabled: false
criteria: 100
blocking: false
+ deny_skipping: true
+ tests_count: 278
description: >-
This test case runs a sub group of tests of the OpenStack
- Defcore testcases.
- dependencies:
- installer: ''
- scenario: ''
+ Platform testcases.
run:
- module:
- 'functest.opnfv_tests.openstack.refstack.refstack'
- class: 'Refstack'
+ name: refstack
+ args:
+ target: platform
+ option:
+ - '--concurrency=4'
-
- case_name: patrole
+ case_name: tempest_full
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ The list of test cases is generated by
+ Tempest automatically and depends on the parameters of
+ the OpenStack deployment.
+ https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
+ run:
+ name: tempest_common
+ args:
+ mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.api)'
+ option:
+ - '--concurrency=4'
+
+ -
+ case_name: tempest_scenario
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ The list of test cases is generated by
+ Tempest automatically and depends on the parameters of
+ the OpenStack deployment.
+ https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
+ run:
+ name: tempest_scenario
+ args:
+ mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)'
+ option:
+ - '--concurrency=1'
+
+ -
+ case_name: tempest_slow
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ The list of test cases is generated by
+ Tempest automatically and depends on the parameters of
+ the OpenStack deployment.
+ https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
+ run:
+ name: tempest_common
+ args:
+ mode: '(?=.*\[.*\bslow\b.*\])(^tempest\.)'
+ option:
+ - '--concurrency=1'
+
+ -
+ case_name: patrole_admin
project_name: functest
criteria: 100
blocking: false
description: >-
Test suite from Patrole project.
- dependencies:
- installer: ''
- scenario: ''
run:
- module: 'functest.opnfv_tests.openstack.patrole.patrole'
- class: 'Patrole'
+ name: patrole
args:
role: 'admin'
- services:
+ includes:
- 'image'
- 'network'
- exclude:
+ excludes:
+ - 'network.test_flavors_rbac'
+ - 'network.test_network_ip_availability_rbac'
- 'test_networks_multiprovider_rbac'
+ - 'test_auto_allocated_topology_rbac'
+ - 'test_create_network_provider_segmentation_id'
+ - 'test_update_network_provider_physical_network'
+ - 'test_update_network_provider_segmentation_id'
+ - 'network.test_agents_rbac'
+ - 'test_list_metadef_namespaces'
-
- case_name: shaker
+ case_name: patrole_user
project_name: functest
criteria: 100
blocking: false
description: >-
- Shaker wraps around popular system network testing tools
- like iperf, iperf3 and netperf (with help of flent). Shaker
- is able to deploy OpenStack instances and networks in
- different topologies.
- dependencies:
- installer: ''
- scenario: ''
+ Test suite from Patrole project.
run:
- module:
- 'functest.opnfv_tests.openstack.shaker.shaker'
- class: 'Shaker'
+ name: patrole
+ args:
+ role: 'user'
+ includes:
+ - 'image'
+ - 'network'
+ excludes:
+ - 'network.test_flavors_rbac'
+ - 'network.test_network_ip_availability_rbac'
+ - 'test_networks_multiprovider_rbac'
+ - 'test_auto_allocated_topology_rbac'
+ - 'test_create_network_provider_segmentation_id'
+ - 'test_update_network_provider_physical_network'
+ - 'test_update_network_provider_segmentation_id'
+ - 'network.test_agents_rbac'
+ - 'test_list_metadef_namespaces'
-
- case_name: snaps_smoke
+ case_name: patrole_reader
project_name: functest
criteria: 100
blocking: false
description: >-
- This test case contains tests that setup and destroy
- environments with VMs with and without Floating IPs
- with a newly created user and project. Set the config
- value snaps.use_floating_ips (True|False) to toggle
- this functionality. When the config value of
- snaps.use_keystone is True, functest must have access to
- the cloud's private network.
-
- dependencies:
- installer: ''
- scenario: '^((?!lxd).)*$'
+ Test suite from Patrole project.
run:
- module: 'functest.opnfv_tests.openstack.snaps.smoke'
- class: 'SnapsSmoke'
+ name: patrole
+ args:
+ role: 'reader'
+ includes:
+ - 'image'
+ - 'network'
+ excludes:
+ - 'network.test_flavors_rbac'
+ - 'network.test_network_ip_availability_rbac'
+ - 'test_networks_multiprovider_rbac'
+ - 'test_auto_allocated_topology_rbac'
+ - 'test_create_network_provider_segmentation_id'
+ - 'test_update_network_provider_physical_network'
+ - 'test_update_network_provider_segmentation_id'
+ - 'network.test_agents_rbac'
+ - 'test_list_metadef_namespaces'
-
- case_name: neutron_trunk
+ case_name: tempest_barbican
project_name: functest
criteria: 100
blocking: false
description: >-
- This test case runs the neutron trunk subtest of the
- OpenStack Tempest suite. The list of test cases is
- generated by Tempest having as input the relevant
- testcase list file.
- dependencies:
- installer: '(fuel)|(apex)|(compass)'
- scenario: ''
+ It leverages on the tempest plugin containing tests used to
+ verify the functionality of a barbican installation.
run:
- module: 'functest.opnfv_tests.openstack.tempest.tempest'
- class: 'TempestNeutronTrunk'
+ name: barbican
+ args:
+ mode:
+ '^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$'
+ services:
+ - barbican
+ option:
+ - '--concurrency=4'
-
- case_name: barbican
+ case_name: tempest_octavia
project_name: functest
criteria: 100
blocking: false
description: >-
It leverages on the tempest plugin containing tests used to
- verify the functionality of a barbican installation
- dependencies:
- installer: '^((?!fuel|apex|compass|daisy).)*$'
- scenario: ''
+ verify the functionality of an octavia installation.
run:
- module: 'functest.opnfv_tests.openstack.tempest.tempest'
- class: 'TempestBarbican'
+ name: tempest_common
+ args:
+ mode: "(?!.*api.v2.test_availability_zone)\
+ (?!.*api.v2.test_availability_zone_profile)\
+ (?!.*api.v2.test_member.MemberAPITest.test_member_ipv4_create)\
+ (?!.*api.v2.test_member.MemberAPITest.test_member_ipv6_create)\
+ (^octavia_tempest_plugin.tests.(api|scenario))"
+ services:
+ - octavia
+ option:
+ - '--concurrency=2'
Code Review / functest.git / blobdiff