run:
name: snaps_health_check
- -
- name: smoke
- order: 1
- description: >-
- Set of basic Functional tests to validate the OPNFV scenarios.
- testcases:
-
case_name: tempest_smoke
project_name: functest
option:
- '--concurrency=4'
+ -
+ name: smoke
+ order: 1
+ description: >-
+ Set of basic Functional tests to validate the OPNFV scenarios.
+ testcases:
-
case_name: neutron-tempest-plugin-api
project_name: functest
- '--concurrency=4'
-
- case_name: patrole
+ case_name: tempest_full
project_name: functest
criteria: 100
blocking: false
description: >-
- Test suite from Patrole project.
+ The list of test cases is generated by
+ Tempest automatically and depends on the parameters of
+ the OpenStack deployment.
+ https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
run:
- name: patrole
+ name: tempest_common
args:
- role: 'admin'
- includes:
- - 'image'
- - 'network'
- excludes:
- - 'test_networks_multiprovider_rbac'
+ mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.api)'
+ option:
+ - '--concurrency=4'
-
- case_name: vmtp
+ case_name: tempest_scenario
project_name: functest
criteria: 100
blocking: false
description: >-
- VMTP is a small python application that will automatically
- perform ping connectivity, round trip time measurement
- (latency) and TCP/UDP throughput
- dependencies:
- - POD_ARCH: '^(?!aarch64$)'
+ The list of test cases is generated by
+ Tempest automatically and depends on the parameters of
+ the OpenStack deployment.
+ https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
run:
- name: vmtp
+ name: tempest_common
+ args:
+ mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)'
+ option:
+ - '--concurrency=1'
-
- case_name: shaker
+ case_name: patrole
project_name: functest
criteria: 100
blocking: false
description: >-
- Shaker wraps around popular system network testing tools
- like iperf, iperf3 and netperf (with help of flent). Shaker
- is able to deploy OpenStack instances and networks in
- different topologies.
+ Test suite from Patrole project.
run:
- name: shaker
+ name: patrole
+ args:
+ role: 'admin'
+ includes:
+ - 'image'
+ - 'network'
+ excludes:
+ - 'network.test_flavors_rbac'
+ - 'network.test_network_ip_availability_rbac'
+ - 'test_networks_multiprovider_rbac'
+ - 'test_auto_allocated_topology_rbac'
-
case_name: snaps_smoke
It leverages on the tempest plugin containing tests used to
verify the functionality of a barbican installation.
run:
- name: tempest_common
+ name: barbican
args:
mode:
- 'barbican_tempest_plugin.tests.(api|scenario).(?!test_image_signing)'
+ '^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$'
services:
- barbican
-
- name: features
+ name: benchmarking
order: 2
+ description: >-
+ Run several OpenStack performance tools
+ https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
+ testcases:
+ -
+ case_name: rally_full
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs the full suite of scenarios of the
+ OpenStack Rally suite using several threads and iterations.
+ run:
+ name: rally_full
+
+ -
+ case_name: rally_jobs
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ This test case runs a group of Rally jobs used in
+ OpenStack gating
+ run:
+ name: rally_jobs
+
+ -
+ case_name: vmtp
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ VMTP is a small python application that will automatically
+ perform ping connectivity, round trip time measurement
+ (latency) and TCP/UDP throughput
+ dependencies:
+ - POD_ARCH: '^(?!aarch64$)'
+ run:
+ name: vmtp
+
+ -
+ case_name: shaker
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ Shaker wraps around popular system network testing tools
+ like iperf, iperf3 and netperf (with help of flent). Shaker
+ is able to deploy OpenStack instances and networks in
+ different topologies.
+ run:
+ name: shaker
+
+ -
+ name: features
+ order: 3
description: >-
Test suites from feature projects
integrated in functest
-
case_name: doctor-notification
project_name: doctor
+ enabled: false
criteria: 100
blocking: false
description: >-
-
case_name: bgpvpn
project_name: sdnvpn
+ enabled: false
criteria: 100
blocking: false
description: >-
-
case_name: functest-odl-sfc
project_name: sfc
+ enabled: false
criteria: 100
blocking: false
description: >-
-
case_name: barometercollectd
project_name: barometer
+ enabled: false
criteria: 100
blocking: false
description: >-
run:
name: barometercollectd
- -
- case_name: fds
- project_name: fastdatastacks
- criteria: 100
- blocking: false
- description: >-
- Test Suite for the OpenDaylight SDN Controller when GBP
- features are installed. It integrates some test suites from
- upstream using Robot as the test framework.
- dependencies:
- - DEPLOY_SCENARIO: 'odl.*-fdio'
- run:
- name: odl
- args:
- suites:
- - /src/fds/testing/robot
-
case_name: vgpu
project_name: functest
-
case_name: stor4nfv_os
project_name: stor4nfv
+ enabled: false
criteria: 100
blocking: false
description: >-
run:
name: stor4nfv_os
- -
- name: components
- order: 3
- description: >-
- Extensive testing of OpenStack API.
- testcases:
- -
- case_name: tempest_full
- project_name: functest
- criteria: 100
- blocking: false
- description: >-
- The list of test cases is generated by
- Tempest automatically and depends on the parameters of
- the OpenStack deployment.
- https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
- run:
- name: tempest_common
- args:
- mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.api)'
- option:
- - '--concurrency=4'
-
- -
- case_name: tempest_scenario
- project_name: functest
- criteria: 100
- blocking: false
- description: >-
- The list of test cases is generated by
- Tempest automatically and depends on the parameters of
- the OpenStack deployment.
- https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
- run:
- name: tempest_common
- args:
- mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)'
- option:
- - '--concurrency=1'
-
- -
- case_name: rally_full
- project_name: functest
- criteria: 100
- blocking: false
- description: >-
- This test case runs the full suite of scenarios of the
- OpenStack Rally suite using several threads and iterations.
- run:
- name: rally_full
-
-
name: vnf
order: 4
blocking: false
description: >-
This test case deploys the Cloudify orchestrator.
- dependencies:
- - DEPLOY_SCENARIO: 'os-.*-nofeature-.*ha'
run:
name: cloudify
-
This test case deploys an OpenSource vIMS solution from
Clearwater using the OpenStack Heat orchestrator.
It also runs some signaling traffic.
- dependencies:
- - DEPLOY_SCENARIO: 'os-.*-nofeature-.*ha'
run:
name: heat_ims
blocking: false
description: >-
This test case is vRouter testing.
- dependencies:
- - DEPLOY_SCENARIO: 'os-.*-nofeature-.*ha'
run:
name: vyos_vrouter
description: >-
vEPC validation with Juju as VNF manager and ABoT as test
executor.
- dependencies:
- - DEPLOY_SCENARIO: 'os-.*-nofeature-.*ha'
run:
name: juju_epc
Code Review / functest.git / blobdiff