6 First tier to be executed to verify the basic
10 case_name: connection_check
11 project_name: functest
15 This test case verifies the retrieval of OpenStack clients:
16 Keystone, Glance, Neutron and Nova and may perform some
19 name: connection_check
22 case_name: tenantnetwork1
23 project_name: functest
27 It creates and configures all tenant network ressources
28 required by advanced testcases (subnet, network and
31 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
36 case_name: tenantnetwork2
37 project_name: functest
41 It creates new user/project before creating and configuring
42 all tenant network ressources required by a testcase
43 (subnet, network and router).
45 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
51 project_name: functest
55 It inherits from TenantNetwork1 which creates all network
56 resources and prepares a future VM attached to that
63 project_name: functest
67 It creates new user/project before creating and configuring
68 all tenant network ressources, flavors, images, etc.
69 required by advanced testcases.
75 project_name: functest
79 It inherits from TenantNetwork1 which creates all network
80 resources and completes it by booting a VM attached to that
87 project_name: functest
91 It creates new user/project before creating and configuring
92 all tenant network ressources and vms required by advanced
99 project_name: functest
103 This test case verifies: 1) SSH to an instance using
104 floating IPs over the public network. 2) Connectivity
105 between 2 instances over a private network.
110 case_name: vping_userdata
111 project_name: functest
115 This test case verifies: 1) Boot a VM with given userdata.
116 2) Connectivity between 2 instances over a private network.
121 case_name: cinder_test
122 project_name: functest
126 This test case verifies: 1) Attach volume and to 1
127 instance; 2) Write data on volume 3) Detach volume
128 from instance 1, attach it on instance 2 3) Read volume
135 project_name: functest
139 Test Suite for the OpenDaylight SDN Controller. It
140 integrates some test suites from upstream using
141 Robot as the test framework.
143 - DEPLOY_SCENARIO: 'odl'
148 - /src/odl_test/csit/suites/integration/basic
149 - /src/odl_test/csit/suites/openstack/neutron
152 case_name: tempest_smoke
153 project_name: functest
157 This test case runs the smoke subset of the OpenStack
158 Tempest suite. The list of test cases is generated by
159 Tempest automatically and depends on the parameters of
160 the OpenStack deplopyment.
161 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L114
165 mode: '(?=.*\[.*\bsmoke\b.*\])(^tempest\.api)'
170 case_name: tempest_horizon
171 project_name: functest
175 This test case runs the Tempest suite proposed by the
178 - DASHBOARD_URL: '^(?!\s*$).+'
180 name: tempest_horizon
182 mode: '^tempest_horizon.'
187 Set of basic Functional tests to validate the OPNFV scenarios.
190 case_name: tempest_neutron
191 project_name: functest
195 This test case runs the Tempest suite proposed by the
196 Neutron project. The list of test cases is generated by
197 Tempest automatically and depends on the parameters of
198 the OpenStack deployment.
202 mode: '^neutron_tempest_plugin\.api'
207 case_name: tempest_cinder
208 project_name: functest
212 This test case runs the Tempest suite proposed by the
217 mode: "(?!.*test_incremental_backup)\
218 (?!.*test_backup_crossproject_admin_negative)\
219 (?!.*test_backup_crossproject_user_negative)\
220 (^cinder_tempest_plugin.)"
225 case_name: tempest_keystone
226 project_name: functest
230 This test case runs the Tempest suite proposed by the
235 mode: 'keystone_tempest_plugin.'
240 case_name: tempest_heat
241 project_name: functest
245 This test case runs the Tempest suite proposed by the
250 mode: '^heat_tempest_plugin.tests'
255 case_name: tempest_telemetry
256 project_name: functest
260 This test case runs the Tempest suite proposed by the
265 mode: "(?!.*test_autoscaling)(?!.*test_live)\
266 (^telemetry_tempest_plugin)"
275 case_name: rally_sanity
276 project_name: functest
280 This test case runs a sub group of tests of the OpenStack
281 Rally suite in smoke mode.
290 case_name: refstack_compute
291 project_name: functest
298 This test case runs a sub group of tests of the OpenStack
308 case_name: refstack_object
309 project_name: functest
315 This test case runs a sub group of tests of the OpenStack
325 case_name: refstack_platform
326 project_name: functest
333 This test case runs a sub group of tests of the OpenStack
343 case_name: tempest_full
344 project_name: functest
348 The list of test cases is generated by
349 Tempest automatically and depends on the parameters of
350 the OpenStack deployment.
351 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
355 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.api)'
360 case_name: tempest_scenario
361 project_name: functest
365 The list of test cases is generated by
366 Tempest automatically and depends on the parameters of
367 the OpenStack deployment.
368 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
372 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)'
377 case_name: tempest_slow
378 project_name: functest
382 The list of test cases is generated by
383 Tempest automatically and depends on the parameters of
384 the OpenStack deployment.
385 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
389 mode: '(?=.*\[.*\bslow\b.*\])(^tempest\.)'
394 case_name: patrole_admin
395 project_name: functest
399 Test suite from Patrole project.
404 mode: "(?!.*test_unmanage_snapshot_rbac)\
405 (?!.*test_show_auto_allocated_topology)\
406 (?!.*test_delete_auto_allocated_topology)\
407 (?!.*test_create_network_provider_segmentation_id)\
408 (?!.*compute.test_floating_ips_rbac)\
409 (?!.*test_create_image_from_volume_backed_server)\
410 (?=.*[.*\bslow\b.*])\
411 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
416 case_name: patrole_member
417 project_name: functest
421 Test suite from Patrole project.
426 mode: "(?!.*test_unmanage_snapshot_rbac)\
427 (?!.*test_show_auto_allocated_topology)\
428 (?!.*test_delete_auto_allocated_topology)\
429 (?!.*test_create_network_provider_segmentation_id)\
430 (?!.*compute.test_floating_ips_rbac)\
431 (?!.*test_create_image_from_volume_backed_server)\
432 (?=.*[.*\bslow\b.*])\
433 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
438 case_name: patrole_reader
439 project_name: functest
443 Test suite from Patrole project.
448 mode: "(?!.*test_unmanage_snapshot_rbac)\
449 (?!.*test_show_auto_allocated_topology)\
450 (?!.*test_delete_auto_allocated_topology)\
451 (?!.*test_create_network_provider_segmentation_id)\
452 (?!.*compute.test_floating_ips_rbac)\
453 (?!.*test_create_image_from_volume_backed_server)\
454 (?=.*[.*\bslow\b.*])\
455 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
460 case_name: tempest_barbican
461 project_name: functest
465 It leverages on the tempest plugin containing tests used to
466 verify the functionality of a barbican installation.
471 '^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$'
478 case_name: tempest_octavia
479 project_name: functest
483 It leverages on the tempest plugin containing tests used to
484 verify the functionality of an octavia installation.
488 mode: "(?!.*api.v2.test_availability_zone)\
489 (?!.*api.v2.test_availability_zone_profile)\
490 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv4_create)\
491 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv6_create)\
492 (^octavia_tempest_plugin.tests.(api|scenario))"
499 case_name: tempest_cyborg
500 project_name: functest
504 It leverages on the tempest plugin containing tests used to
505 verify the functionality of a cyborg installation.
509 mode: '^cyborg_tempest_plugin'
518 Set of basic Functional tests to validate the OPNFV scenarios.
521 case_name: tempest_neutron_cntt
522 project_name: functest
528 This test case runs the Tempest suite proposed by the
529 Neutron project. The list of test cases is generated by
530 Tempest automatically and depends on the parameters of
531 the OpenStack deployment.
535 mode: "(?!.*admin.test_agent_availability_zone)\
536 (?!.*admin.test_dhcp_agent_scheduler)\
537 (?!.*admin.test_l3_agent_scheduler)\
538 (?!.*admin.test_logging)\
539 (?!.*admin.test_logging_negative)\
540 (?!.*admin.test_network_segment_range)\
541 (?!.*admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address)\
542 (?!.*admin.test_ports.PortTestCasesResourceRequest)\
543 (?!.*admin.test_routers_dvr)\
544 (?!.*admin.test_routers_flavors)\
545 (?!.*admin.test_routers_ha)\
546 (?!.*test_conntrack_helper)\
547 (?!.*test_floating_ips.FloatingIPPoolTestJSON)\
548 (?!.*test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details)\
549 (?!.*test_metering_extensions)\
550 (?!.*test_metering_negative)\
551 (?!.*test_networks.NetworksSearchCriteriaTest.test_list_validation_filters)\
552 (?!.*test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan)\
553 (?!.*test_networks.NetworksTestJSON.test_create_update_network_dns_domain)\
554 (?!.*test_port_forwardings)\
555 (?!.*test_ports.PortsTaggingOnCreation)\
556 (?!.*test_ports.PortsTestJSON.test_create_port_with_propagate_uplink_status)\
557 (?!.*test_ports.PortsTestJSON.test_create_port_without_propagate_uplink_status)\
558 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_domain)\
559 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_name)\
560 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name)\
561 (?!.*test_qos.QosMinimumBandwidthRuleTestJSON)\
562 (?!.*test_revisions.TestRevisions.test_update_dns_domain_bumps_revision)\
563 (?!.*test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision)\
564 (?!.*test_router_interface_fip)\
565 (?!.*test_routers.DvrRoutersTest)\
566 (?!.*test_routers.HaRoutersTest)\
567 (?!.*test_routers.RoutersIpV6Test.test_extra_routes_atomic)\
568 (?!.*test_routers.RoutersTest.test_extra_routes_atomic)\
569 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
570 (?!.*test_routers_negative.DvrRoutersNegativeTestExtended)\
571 (?!.*test_routers_negative.HaRoutersNegativeTest)\
572 (?!.*test_security_groups.RbacSharedSecurityGroupTest)\
573 (?!.*test_subnetpool_prefix_ops)\
574 (?!.*test_subnetpools.RbacSubnetPoolTest)\
575 (?!.*test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters)\
576 (?!.*test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_subnetpool_associate_shared_address_scope)\
577 (?!.*test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters)\
578 (?!.*test_timestamp.TestTimeStamp.test_segment_with_timestamp)\
579 (?!.*test_trunk.TrunkTestInheritJSONBase.test_add_subport)\
580 (?!.*test_trunk.TrunkTestMtusJSON)\
581 (?!.*test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type)\
582 (?!.*test_trunk_negative.TrunkTestMtusJSON)\
583 (^neutron_tempest_plugin.api)"
588 case_name: tempest_cinder_cntt
589 project_name: functest
595 This test case runs the Tempest suite proposed by the
600 mode: "(?!.*test_incremental_backup)\
601 (?!.*test_consistencygroups)\
602 (?!.*test_backup_crossproject_admin_negative)\
603 (?!.*test_backup_crossproject_user_negative)\
604 (^cinder_tempest_plugin.)"
609 case_name: tempest_keystone_cntt
610 project_name: functest
616 This test case runs the Tempest suite proposed by the
621 mode: "(?!.*api.identity.v3.test_oauth1_tokens)\
622 (?!.*scenario.test_federated_authentication)\
623 keystone_tempest_plugin."
628 case_name: tempest_heat_cntt
629 project_name: functest
635 This test case runs the Tempest suite proposed by the
640 mode: "(?!.*functional.test_lbaasv2)\
641 (?!.*functional.test_encryption_vol_type)\
642 (?!.*RemoteStackTest.test_stack_create_with_cloud_credential)\
643 (?!.*scenario.test_aodh_alarm)\
644 (?!.*tests.scenario.test_autoscaling_lb)\
645 (?!.*scenario.test_autoscaling_lbv2)\
646 (?!.*scenario.test_server_software_config)\
647 (?!.*test_volumes.VolumeBackupRestoreIntegrationTest)\
648 (?!.*scenario.test_octavia_lbaas)\
649 (?!.*scenario.test_server_cfn_init)\
650 ^heat_tempest_plugin.tests"
655 case_name: rally_sanity_cntt
656 project_name: functest
660 This test case runs a sub group of tests of the OpenStack
661 Rally suite in smoke mode.
677 case_name: tempest_full_cntt
678 project_name: functest
684 The list of test cases is generated by
685 Tempest automatically and depends on the parameters of
686 the OpenStack deployment.
687 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
691 mode: "(?!.*test_fixed_ips)\
692 (?!.*test_fixed_ips_negative)\
693 (?!.*test_auto_allocate_network)(?!.*test_floating_ips_bulk)\
694 (?!.*test_flavors_microversions.FlavorsV255TestJSON)\
695 (?!.*test_flavors_microversions.FlavorsV261TestJSON)\
696 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_iscsi_volume)\
697 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration)\
698 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration_paused)\
699 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_volume_backed_live_migration)\
700 (?!.*test_live_migration.LiveMigrationTest.test_iscsi_volume)\
701 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration)\
702 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration_paused)\
703 (?!.*test_live_migration.LiveMigrationTest.test_volume_backed_live_migration)\
704 (?!.*test_live_migration.LiveMigrationRemoteConsolesV26Test)\
705 (?!.*test_quotas.QuotasAdminTestV257)\
706 (?!.*certificates.test_certificates)\
707 (?!.*test_quotas_negative.QuotasSecurityGroupAdminNegativeTest)\
708 (?!.*test_novnc)(?!.*test_server_personality)\
709 (?!.*test_servers.ServerShowV263Test.test_show_update_rebuild_list_server)\
710 (?!.*test_servers_microversions.ServerShowV254Test)\
711 (?!.*test_servers_microversions.ServerShowV257Test)\
712 (?!.*test_servers_negative.ServersNegativeTestJSON.test_personality_file_contents_not_encoded)\
713 (?!.*servers.test_virtual_interfaces)\
714 (?!.*test_server_actions.ServerActionsTestJSON.test_change_server_password)\
715 (?!.*test_server_actions.ServerActionsTestJSON.test_get_vnc_console)\
716 (?!.*test_server_actions.ServerActionsTestJSON.test_reboot_server_soft)\
717 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
718 (?!.*test_server_rescue.ServerStableDeviceRescueTest)\
719 (?!.*test_security_group_default_rules)\
720 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_duplicate_name)\
721 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_description)\
722 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_name)\
723 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_des)\
724 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_id)\
725 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_name)\
726 (?!.*test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex)\
727 (?!.*compute.test_virtual_interfaces)(?!.*compute.test_virtual_interfaces_negative)\
728 (?!.*compute.test_networks)\
729 (?!.*test_attach_volume.AttachVolumeMultiAttach)\
730 (?!.*identity.admin.v2)(?!.*identity.v2)\
732 (?!.*image.v2.test_images.ImportImagesTest)\
733 (?!.*admin.test_dhcp_agent_scheduler)\
734 (?!.*admin.test_routers_dvr)\
735 (?!.*test_metering_extensions)(?!.*network.test_tags)\
736 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
737 (?!.*test_routers.RoutersIpV6Test.test_create_router_set_gateway_with_fixed_ip)\
738 (?!.*test_routers.RoutersTest.test_create_router_set_gateway_with_fixed_ip)\
739 (?!.*test_group_snapshots.GroupSnapshotsV319Test.test_reset_group_snapshot_status)\
740 (?!.*test_multi_backend)\
741 (?!.*test_volume_retype.VolumeRetypeWithMigrationTest)\
742 (?!.*test_volume_delete_cascade.VolumesDeleteCascade.test_volume_from_snapshot_cascade_delete)\
743 (?!.*test_volumes_backup.VolumesBackupsTest.test_volume_backup_create_get_detailed_list_restore_delete)\
744 (?!.*test_volumes_negative.UpdateMultiattachVolumeNegativeTest.test_multiattach_rw_volume_update_failure)\
745 (?!.*test_volumes_extend.VolumesExtendAttachedTest.test_extend_attached_volume)\
746 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.api)"
751 case_name: tempest_scenario_cntt
752 project_name: functest
758 The list of test cases is generated by
759 Tempest automatically and depends on the parameters of
760 the OpenStack deployment.
761 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
763 name: tempest_scenario
766 (?!.*test_volume_boot_pattern.TestVolumeBootPattern.test_boot_server_from_encrypted_volume_luks)\
767 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.scenario)"
772 case_name: tempest_slow_cntt
773 project_name: functest
779 The list of test cases is generated by
780 Tempest automatically and depends on the parameters of
781 the OpenStack deployment.
782 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
786 mode: "(?!.*test_volume_swap)\
787 (?!.*test_server_personality)\
788 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
789 (?!.*test_container_sync.ContainerSyncTest.test_container_synchronization)\
790 (?!.*test_container_sync_middleware.ContainerSyncMiddlewareTest.test_container_synchronization)\
791 (?!.*test_encrypted_cinder_volumes)\
792 (?!.*test_minbw_allocation_placement)\
793 (?!.*test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling)\
794 (?!.*test_volume_migrate_attached)\
795 (?!.*test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration_revert)\
796 (?=.*\\[.*\\bslow\\b.*\\])(^tempest.)"
803 Run several OpenStack performance tools
804 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
807 case_name: rally_full
808 project_name: functest
812 This test case runs the full suite of scenarios of the
813 OpenStack Rally suite using several threads and iterations.
822 case_name: rally_jobs
823 project_name: functest
827 This test case runs a group of Rally jobs used in
837 project_name: functest
841 VMTP is a small python application that will automatically
842 perform ping connectivity, round trip time measurement
843 (latency) and TCP/UDP throughput
845 - POD_ARCH: '^(?!aarch64$)'
851 project_name: functest
855 Shaker wraps around popular system network testing tools
856 like iperf, iperf3 and netperf (with help of flent). Shaker
857 is able to deploy OpenStack instances and networks in
858 different topologies.
860 - POD_ARCH: '^(?!aarch64$)'
865 name: benchmarking_cntt
867 Run several OpenStack performance tools
868 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
871 case_name: rally_full_cntt
872 project_name: functest
876 This test case runs the full suite of scenarios of the
877 OpenStack Rally suite using several threads and iterations.
893 case_name: rally_jobs_cntt
894 project_name: functest
898 This test case runs a group of Rally jobs used in
909 Collection of VNF test cases.
913 project_name: functest
917 This test case deploys the Cloudify orchestrator.
921 case_name: cloudify_ims
922 project_name: functest
926 This test case deploys an OpenSource vIMS solution from
927 Clearwater using the Cloudify orchestrator. It also runs
928 some signaling traffic.
930 - DEPLOY_SCENARIO: 'os-.*-nofeature-.*ha'
936 project_name: functest
940 This test case deploys an OpenSource vIMS solution from
941 Clearwater using the OpenStack Heat orchestrator.
942 It also runs some signaling traffic.
947 case_name: vyos_vrouter
948 project_name: functest
952 This test case is vRouter testing.
958 project_name: functest
962 vEPC validation with Juju as VNF manager and ABoT as test