testcases:
-
name: healthcheck
+ criteria: 'status == "PASS"'
description: >-
This test case verifies the basic OpenStack services like
Keystone, Glance, Cinder, Neutron and Nova.
testcases:
-
name: vping_ssh
+ criteria: 'status == "PASS"'
description: >-
This test case verifies: 1) SSH to an instance using floating
IPs over the public network. 2) Connectivity between 2 instances
-
name: vping_userdata
+ criteria: 'status == "PASS"'
description: >-
This test case verifies: 1) Boot a VM with given userdata.
2) Connectivity between 2 instances over a private network.
-
name: tempest_smoke_serial
+ criteria: 'success_rate == 100%'
description: >-
This test case runs the smoke subset of the OpenStack
Tempest suite. The list of test cases is generated by
-
name: rally_sanity
+ criteria: 'success_rate == 100%'
description: >-
This test case runs a sub group of tests of the OpenStack
Rally suite in smoke mode.
testcases:
-
name: odl
+ criteria: 'success_rate == 100%'
description: >-
Test Suite for the OpenDaylight SDN Controller. It integrates
some test suites from upstream using Robot as the test
-
name: onos
+ criteria: 'status == "PASS"'
description: >-
Test Suite for the ONOS SDN Controller. It integrates
some test suites from upstream using TestON as the test
-
name: ovno
+ criteria: 'status == "PASS"'
description: >-
Test Suite for the Open Contrail SDN Controller.
framework.
testcases:
-
name: promise
+ criteria: 'success_rate == 100%'
description: >-
Test suite from Promise project.
dependencies:
-
name: doctor
+ criteria: 'status == "PASS"'
description: >-
Test suite from Doctor project.
dependencies:
-
name: bgpvpn
+ criteria: 'status == "PASS"'
description: >-
Test suite from SDNVPN project.
dependencies:
-
name: security_scan
+ criteria: 'status == "PASS"'
description: >-
Simple security Scan
dependencies:
testcases:
-
name: tempest_full_parallel
+ criteria: 'success_rate >= 80%'
description: >-
The list of test cases is generated by
Tempest automatically and depends on the parameters of
-
name: rally_full
+ criteria: 'success_rate >= 90%'
description: >-
This test case runs the full suite of scenarios of the OpenStack
Rally suite using several threads and iterations.
testcases:
-
name: vims
+ criteria: 'status == "PASS"'
description: >-
This test case deploys an OpenSource vIMS solution from Clearwater
using the Cloudify orchestrator. It also runs some signaling traffic.