the number of test cases may vary from 1 installer to another and from 1
scenario to another.
-The list of scenario supported by installer can be described as follows::
+The list of scenario supported by installer can be described as follows:
- +================+=========+=========+=========+=========+
- | Scenario | Apex | Compass | Fuel | Joid |
- +================+=========+=========+=========+=========+
- | odl_l2 | X | X | X | X |
- +----------------+---------+---------+---------+---------+
- | odl_l3 | X | | X | |
- +----------------+---------+---------+---------+---------+
- | onos | X | X | X | X |
- +----------------+---------+---------+---------+---------+
- | nosdn | | X | X | X |
- +----------------+---------+---------+---------+---------+
- | odl_l2-sfc | X | | | |
- +----------------+---------+---------+---------+---------+
- | odl_l2-bgpvpn | | | X | |
- +----------------+---------+---------+---------+---------+
- | ovs (dpdk) | | | X | |
- +----------------+---------+---------+---------+---------+
++----------------+---------+---------+---------+---------+
+| Scenario | Apex | Compass | Fuel | Joid |
++================+=========+=========+=========+=========+
+| odl_l2 | X | X | X | X |
++----------------+---------+---------+---------+---------+
+| onos | | X | | |
++----------------+---------+---------+---------+---------+
+| nosdn | | X | X | |
++----------------+---------+---------+---------+---------+
+| ovs (dpdk) | | | X | |
++----------------+---------+---------+---------+---------+
The matrix below details the Functest runnable tests versus the installer and
-the scenario::
+the scenario:
- +================+=============+=============+=============+=============+
- | Test cases | Apex | Compass | Fuel | Joid |
- +================+=============+=============+=============+=============+
- | vPing |all scenario | all | all | all |
- +----------------+-------------+-------------+-------------+-------------+
- | vPing userdata | all except | all except | all except | all except |
- | | ONOS | ONOS | ONOS | ONOS |
- +----------------+-------------+-------------+-------------+-------------+
- | Tempest | all | all | all | all |
- +----------------+-------------+-------------+-------------+-------------+
- | Rally | all | all | all | all |
- +----------------+-------------+-------------+-------------+-------------+
- | ODL | all ODL | all ODL | all ODL | all ODL |
- +----------------+-------------+-------------+-------------+-------------+
- | ONOS | ONOS | ONOS | ONOS | ONOS |
- +----------------+-------------+-------------+-------------+-------------+
- | Promise | no | no | all | all |
- +----------------+-------------+-------------+-------------+-------------+
- | vIMS | all except | all except | all except | all except |
- | | ONOS | ONOS | ONOS | ONOS |
- +----------------+-------------+-------------+-------------+-------------+
- | Doctor | all | no | no | no |
- +----------------+-------------+-------------+-------------+-------------+
- | SDNVPN | no | no | bgpvpn | no |
- +----------------+-------------+-------------+-------------+-------------+
++----------------+-------------+-------------+-------------+-------------+
+| Test cases | Apex | Compass | Fuel | Joid |
++================+=============+=============+=============+=============+
+| vPing SSH | all | all | all | all |
++----------------+-------------+-------------+-------------+-------------+
+| vPing userdata | all except | all except | all except | all except |
+| | ONOS | ONOS | ONOS | ONOS |
++----------------+-------------+-------------+-------------+-------------+
+| Tempest | all | all | all | all |
++----------------+-------------+-------------+-------------+-------------+
+| Rally | all | all | all | all |
++----------------+-------------+-------------+-------------+-------------+
+| ODL | all ODL | all ODL | all ODL | all ODL |
++----------------+-------------+-------------+-------------+-------------+
+| ONOS | ONOS | ONOS | ONOS | ONOS |
++----------------+-------------+-------------+-------------+-------------+
+| Promise | no | no | all | all |
++----------------+-------------+-------------+-------------+-------------+
+| vIMS | all except | all except | all except | all except |
+| | ONOS | ONOS | ONOS | ONOS |
++----------------+-------------+-------------+-------------+-------------+
+| Doctor | all | no | no | no |
++----------------+-------------+-------------+-------------+-------------+
+
+all means that the test case is run on all the scenarios related to the
+installer.
Functest results from continuous integration can be found in:
* jenkins logs: https://build.opnfv.org/ci/view/functest/