X-Git-Url: https://gerrit.opnfv.org/gerrit/gitweb?a=blobdiff_plain;f=docker%2Fsmoke%2Ftestcases.yaml;h=8e2947cc89b5bd9098ff663e6277a43f7546ec00;hb=5ac878fe7cccbfe5cb829488d0aedc307dd42885;hp=ca2126173ee5828934e7804493b62700ad892ce3;hpb=e5f28f769cf230af91cdd6651e19c64fba22e5a2;p=functest.git diff --git a/docker/smoke/testcases.yaml b/docker/smoke/testcases.yaml index ca2126173..8e2947cc8 100644 --- a/docker/smoke/testcases.yaml +++ b/docker/smoke/testcases.yaml @@ -3,107 +3,79 @@ tiers: - name: smoke order: 1 - ci_loop: '(daily)|(weekly)' description: >- Set of basic Functional tests to validate the OPNFV scenarios. testcases: - - case_name: vping_ssh + case_name: tempest_smoke project_name: functest criteria: 100 blocking: false description: >- - This test case verifies: 1) SSH to an instance using - floating IPs over the public network. 2) Connectivity - between 2 instances over a private network. - dependencies: - installer: '' - scenario: '^((?!lxd).)*$' - run: - module: 'functest.opnfv_tests.openstack.vping.vping_ssh' - class: 'VPingSSH' - - - - case_name: vping_userdata - project_name: functest - criteria: 100 - blocking: false - description: >- - This test case verifies: 1) Boot a VM with given userdata. - 2) Connectivity between 2 instances over a private network. - dependencies: - installer: '' - scenario: '^((?!lxd).)*$' + This test case runs the smoke subset of the OpenStack + Tempest suite. The list of test cases is generated by + Tempest automatically and depends on the parameters of + the OpenStack deplopyment. + https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L114 run: - module: - 'functest.opnfv_tests.openstack.vping.vping_userdata' - class: 'VPingUserdata' + name: tempest_common + args: + mode: '(?=.*\[.*\bsmoke\b.*\])(^tempest\.api)' + option: + - '--concurrency=4' - - case_name: cinder_test + case_name: neutron-tempest-plugin-api project_name: functest criteria: 100 blocking: false description: >- - This test case verifies: 1) Attach volume and to 1 - instance; 2) Write data on volume 3) Detach volume - from instance 1, attach it on instance 2 3) Read volume - data - dependencies: - installer: '' - scenario: '^((?!lxd).)*$' + This test case runs the Tempest suite proposed by the + Neutron project. The list of test cases is generated by + Tempest automatically and depends on the parameters of + the OpenStack deployment. run: - module: 'functest.opnfv_tests.openstack.cinder.cinder_test' - class: 'CinderCheck' + name: tempest_common + args: + mode: '^neutron_tempest_plugin\.api' + option: + - '--concurrency=4' - - case_name: tempest_smoke_serial + case_name: rally_sanity project_name: functest criteria: 100 blocking: false description: >- - This test case runs the smoke subset of the OpenStack - Tempest suite. The list of test cases is generated by - Tempest automatically and depends on the parameters of - the OpenStack deplopyment. - dependencies: - installer: '' - scenario: '' + This test case runs a sub group of tests of the OpenStack + Rally suite in smoke mode. run: - module: 'functest.opnfv_tests.openstack.tempest.tempest' - class: 'TempestSmokeSerial' + name: rally_sanity - - case_name: rally_sanity + case_name: rally_jobs project_name: functest criteria: 100 blocking: false description: >- - This test case runs a sub group of tests of the OpenStack - Rally suite in smoke mode. - dependencies: - installer: '' - scenario: '' + This test case runs a group of Rally jobs used in + OpenStack gating run: - module: 'functest.opnfv_tests.openstack.rally.rally' - class: 'RallySanity' + name: rally_jobs - case_name: refstack_defcore project_name: functest - enabled: false criteria: 100 blocking: false description: >- This test case runs a sub group of tests of the OpenStack Defcore testcases. - dependencies: - installer: '' - scenario: '' run: - module: - 'functest.opnfv_tests.openstack.refstack.refstack' - class: 'Refstack' + name: refstack_defcore + args: + option: + - '--concurrency=4' - case_name: patrole @@ -112,95 +84,88 @@ tiers: blocking: false description: >- Test suite from Patrole project. - dependencies: - installer: '' - scenario: '' run: - module: 'functest.opnfv_tests.openstack.patrole.patrole' - class: 'Patrole' + name: patrole args: role: 'admin' - services: + includes: - 'image' - 'network' - exclude: + excludes: - 'test_networks_multiprovider_rbac' + - 'test_auto_allocated_topology_rbac' + - 'test_address_scope_rbac' - - case_name: shaker + case_name: snaps_smoke project_name: functest criteria: 100 blocking: false description: >- - Shaker wraps around popular system network testing tools - like iperf, iperf3 and netperf (with help of flent). Shaker - is able to deploy OpenStack instances and networks in - different topologies. - dependencies: - installer: '' - scenario: '' + This test case contains tests that setup and destroy + environments with VMs with and without Floating IPs + with a newly created user and project. Set the config + value snaps.use_floating_ips (True|False) to toggle + this functionality. When the config value of + snaps.use_keystone is True, functest must have access to + the cloud's private network. run: - module: - 'functest.opnfv_tests.openstack.shaker.shaker' - class: 'Shaker' + name: snaps_smoke - - case_name: odl + case_name: neutron_trunk project_name: functest criteria: 100 blocking: false description: >- - Test Suite for the OpenDaylight SDN Controller. It - integrates some test suites from upstream using - Robot as the test framework. - dependencies: - installer: '' - scenario: 'odl' + This test case runs the neutron trunk subtest of the + OpenStack Tempest suite. The list of test cases is + generated by Tempest having as input the relevant + testcase list file. run: - module: 'functest.opnfv_tests.sdn.odl.odl' - class: 'ODLTests' + name: tempest_common args: - suites: - - /src/odl_test/csit/suites/integration/basic - - /src/odl_test/csit/suites/openstack/neutron + mode: 'neutron_tempest_plugin.(api|scenario).test_trunk' + neutron_extensions: + - trunk + - trunk-details - - case_name: snaps_smoke + case_name: networking-bgpvpn project_name: functest criteria: 100 blocking: false description: >- - This test case contains tests that setup and destroy - environments with VMs with and without Floating IPs - with a newly created user and project. Set the config - value snaps.use_floating_ips (True|False) to toggle - this functionality. When the config value of - snaps.use_keystone is True, functest must have access to - the cloud's private network. - - dependencies: - installer: '' - scenario: '^((?!lxd).)*$' + This test case runs OpenStack networking-bgpvpn Tempest + suite. The list of test cases is generated by Tempest + having as input the relevant regex. run: - module: 'functest.opnfv_tests.openstack.snaps.smoke' - class: 'SnapsSmoke' + name: tempest_common + args: + mode: '^networking_bgpvpn_tempest\.' + neutron_extensions: + - bgpvpn + option: + - '--concurrency=4' - - case_name: neutron_trunk + case_name: networking-sfc project_name: functest criteria: 100 blocking: false description: >- - This test case runs the neutron trunk subtest of the - OpenStack Tempest suite. The list of test cases is - generated by Tempest having as input the relevant - testcase list file. - dependencies: - installer: '(fuel)|(apex)|(compass)' - scenario: '' + This test case runs OpenStack networking-sfc Tempest + suite. The list of test cases is generated by Tempest + having as input the relevant regex. run: - module: 'functest.opnfv_tests.openstack.tempest.tempest' - class: 'TempestNeutronTrunk' + name: tempest_common + args: + mode: + '^(?:networking_sfc\.tests\.tempest_plugin.tests.api).*$' + neutron_extensions: + - sfc + option: + - '--concurrency=0' - case_name: barbican @@ -209,10 +174,11 @@ tiers: blocking: false description: >- It leverages on the tempest plugin containing tests used to - verify the functionality of a barbican installation - dependencies: - installer: '^((?!fuel|apex|compass|daisy).)*$' - scenario: '' + verify the functionality of a barbican installation. run: - module: 'functest.opnfv_tests.openstack.tempest.tempest' - class: 'TempestBarbican' + name: barbican + args: + mode: + '^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$' + services: + - barbican