6 First tier to be executed to verify the basic
10 case_name: connection_check
11 project_name: functest
15 This test case verifies the retrieval of OpenStack clients:
16 Keystone, Glance, Neutron and Nova and may perform some
19 name: connection_check
22 case_name: tenantnetwork1
23 project_name: functest
27 It creates and configures all tenant network ressources
28 required by advanced testcases (subnet, network and
34 case_name: tenantnetwork2
35 project_name: functest
39 It creates new user/project before creating and configuring
40 all tenant network ressources required by a testcase
41 (subnet, network and router).
47 project_name: functest
51 It inherits from TenantNetwork1 which creates all network
52 resources and prepares a future VM attached to that
59 project_name: functest
63 It creates new user/project before creating and configuring
64 all tenant network ressources, flavors, images, etc.
65 required by advanced testcases.
71 project_name: functest
75 It inherits from TenantNetwork1 which creates all network
76 resources and completes it by booting a VM attached to that
83 project_name: functest
87 It creates new user/project before creating and configuring
88 all tenant network ressources and vms required by advanced
95 project_name: functest
99 This test case verifies: 1) SSH to an instance using
100 floating IPs over the public network. 2) Connectivity
101 between 2 instances over a private network.
106 case_name: vping_userdata
107 project_name: functest
111 This test case verifies: 1) Boot a VM with given userdata.
112 2) Connectivity between 2 instances over a private network.
117 case_name: cinder_test
118 project_name: functest
122 This test case verifies: 1) Attach volume and to 1
123 instance; 2) Write data on volume 3) Detach volume
124 from instance 1, attach it on instance 2 3) Read volume
131 project_name: functest
135 Test Suite for the OpenDaylight SDN Controller. It
136 integrates some test suites from upstream using
137 Robot as the test framework.
139 - DEPLOY_SCENARIO: 'odl'
144 - /src/odl_test/csit/suites/integration/basic
145 - /src/odl_test/csit/suites/openstack/neutron
148 case_name: tempest_smoke
149 project_name: functest
153 This test case runs the smoke subset of the OpenStack
154 Tempest suite. The list of test cases is generated by
155 Tempest automatically and depends on the parameters of
156 the OpenStack deplopyment.
157 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L114
161 mode: '(?=.*\[.*\bsmoke\b.*\])(^tempest\.api)'
166 case_name: tempest_horizon
167 project_name: functest
171 This test case runs the Tempest suite proposed by the
174 - DASHBOARD_URL: '^(?!\s*$).+'
176 name: tempest_horizon
178 mode: '^tempest_horizon.'
183 Set of basic Functional tests to validate the OPNFV scenarios.
186 case_name: tempest_neutron
187 project_name: functest
191 This test case runs the Tempest suite proposed by the
192 Neutron project. The list of test cases is generated by
193 Tempest automatically and depends on the parameters of
194 the OpenStack deployment.
198 mode: '^neutron_tempest_plugin\.api'
203 case_name: tempest_cinder
204 project_name: functest
208 This test case runs the Tempest suite proposed by the
213 mode: "(?!.*test_incremental_backup)\
214 (?!.*test_backup_crossproject_admin_negative)\
215 (?!.*test_backup_crossproject_user_negative)\
216 (^cinder_tempest_plugin.)"
221 case_name: tempest_keystone
222 project_name: functest
226 This test case runs the Tempest suite proposed by the
231 mode: 'keystone_tempest_plugin.'
236 case_name: tempest_heat
237 project_name: functest
241 This test case runs the Tempest suite proposed by the
246 mode: '^heat_tempest_plugin.tests'
251 case_name: tempest_telemetry
252 project_name: functest
256 This test case runs the Tempest suite proposed by the
261 mode: "(?!.*test_autoscaling)(?!.*test_live)\
262 (^telemetry_tempest_plugin)"
271 case_name: rally_sanity
272 project_name: functest
276 This test case runs a sub group of tests of the OpenStack
277 Rally suite in smoke mode.
286 case_name: refstack_compute
287 project_name: functest
293 This test case runs a sub group of tests of the OpenStack
303 case_name: refstack_object
304 project_name: functest
310 This test case runs a sub group of tests of the OpenStack
320 case_name: refstack_platform
321 project_name: functest
327 This test case runs a sub group of tests of the OpenStack
337 case_name: tempest_full
338 project_name: functest
342 The list of test cases is generated by
343 Tempest automatically and depends on the parameters of
344 the OpenStack deployment.
345 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
349 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.api)'
354 case_name: tempest_scenario
355 project_name: functest
359 The list of test cases is generated by
360 Tempest automatically and depends on the parameters of
361 the OpenStack deployment.
362 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
366 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)'
371 case_name: tempest_slow
372 project_name: functest
376 The list of test cases is generated by
377 Tempest automatically and depends on the parameters of
378 the OpenStack deployment.
379 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
383 mode: '(?=.*\[.*\bslow\b.*\])(^tempest\.)'
388 case_name: patrole_admin
389 project_name: functest
393 Test suite from Patrole project.
398 mode: "(?!.*test_unmanage_snapshot_rbac)\
399 (?!.*test_show_auto_allocated_topology)\
400 (?!.*test_delete_auto_allocated_topology)\
401 (?!.*test_create_network_provider_segmentation_id)\
402 (?!.*compute.test_floating_ips_rbac)\
403 (?!.*test_create_image_from_volume_backed_server)\
404 (?=.*[.*\bslow\b.*])\
405 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
410 case_name: patrole_member
411 project_name: functest
415 Test suite from Patrole project.
420 mode: "(?!.*test_unmanage_snapshot_rbac)\
421 (?!.*test_show_auto_allocated_topology)\
422 (?!.*test_delete_auto_allocated_topology)\
423 (?!.*test_create_network_provider_segmentation_id)\
424 (?!.*compute.test_floating_ips_rbac)\
425 (?!.*test_create_image_from_volume_backed_server)\
426 (?=.*[.*\bslow\b.*])\
427 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
432 case_name: patrole_reader
433 project_name: functest
437 Test suite from Patrole project.
442 mode: "(?!.*test_unmanage_snapshot_rbac)\
443 (?!.*test_show_auto_allocated_topology)\
444 (?!.*test_delete_auto_allocated_topology)\
445 (?!.*test_create_network_provider_segmentation_id)\
446 (?!.*compute.test_floating_ips_rbac)\
447 (?!.*test_create_image_from_volume_backed_server)\
448 (?=.*[.*\bslow\b.*])\
449 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
454 case_name: tempest_barbican
455 project_name: functest
459 It leverages on the tempest plugin containing tests used to
460 verify the functionality of a barbican installation.
465 '^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$'
472 case_name: tempest_octavia
473 project_name: functest
477 It leverages on the tempest plugin containing tests used to
478 verify the functionality of an octavia installation.
482 mode: "(?!.*api.v2.test_availability_zone)\
483 (?!.*api.v2.test_availability_zone_profile)\
484 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv4_create)\
485 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv6_create)\
486 (^octavia_tempest_plugin.tests.(api|scenario))"
493 case_name: tempest_cyborg
494 project_name: functest
498 It leverages on the tempest plugin containing tests used to
499 verify the functionality of a cyborg installation.
503 mode: '^cyborg_tempest_plugin'
512 Set of basic Functional tests to validate the OPNFV scenarios.
515 case_name: tempest_neutron_cntt
516 project_name: functest
522 This test case runs the Tempest suite proposed by the
523 Neutron project. The list of test cases is generated by
524 Tempest automatically and depends on the parameters of
525 the OpenStack deployment.
529 mode: "(?!.*admin.test_agent_availability_zone)\
530 (?!.*admin.test_dhcp_agent_scheduler)\
531 (?!.*admin.test_l3_agent_scheduler)\
532 (?!.*admin.test_logging)\
533 (?!.*admin.test_logging_negative)\
534 (?!.*admin.test_network_segment_range)\
535 (?!.*admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address)\
536 (?!.*admin.test_ports.PortTestCasesResourceRequest)\
537 (?!.*admin.test_routers_dvr)\
538 (?!.*admin.test_routers_flavors)\
539 (?!.*admin.test_routers_ha)\
540 (?!.*test_conntrack_helper)\
541 (?!.*test_floating_ips.FloatingIPPoolTestJSON)\
542 (?!.*test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details)\
543 (?!.*test_metering_extensions)\
544 (?!.*test_metering_negative)\
545 (?!.*test_networks.NetworksSearchCriteriaTest.test_list_validation_filters)\
546 (?!.*test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan)\
547 (?!.*test_networks.NetworksTestJSON.test_create_update_network_dns_domain)\
548 (?!.*test_port_forwardings)\
549 (?!.*test_ports.PortsTaggingOnCreation)\
550 (?!.*test_ports.PortsTestJSON.test_create_port_with_propagate_uplink_status)\
551 (?!.*test_ports.PortsTestJSON.test_create_port_without_propagate_uplink_status)\
552 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_domain)\
553 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_name)\
554 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name)\
555 (?!.*test_qos.QosMinimumBandwidthRuleTestJSON)\
556 (?!.*test_revisions.TestRevisions.test_update_dns_domain_bumps_revision)\
557 (?!.*test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision)\
558 (?!.*test_router_interface_fip)\
559 (?!.*test_routers.DvrRoutersTest)\
560 (?!.*test_routers.HaRoutersTest)\
561 (?!.*test_routers.RoutersIpV6Test.test_extra_routes_atomic)\
562 (?!.*test_routers.RoutersTest.test_extra_routes_atomic)\
563 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
564 (?!.*test_routers_negative.DvrRoutersNegativeTestExtended)\
565 (?!.*test_routers_negative.HaRoutersNegativeTest)\
566 (?!.*test_security_groups.RbacSharedSecurityGroupTest)\
567 (?!.*test_subnetpool_prefix_ops)\
568 (?!.*test_subnetpools.RbacSubnetPoolTest)\
569 (?!.*test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters)\
570 (?!.*test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_subnetpool_associate_shared_address_scope)\
571 (?!.*test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters)\
572 (?!.*test_timestamp.TestTimeStamp.test_segment_with_timestamp)\
573 (?!.*test_trunk.TrunkTestInheritJSONBase.test_add_subport)\
574 (?!.*test_trunk.TrunkTestMtusJSON)\
575 (?!.*test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type)\
576 (?!.*test_trunk_negative.TrunkTestMtusJSON)\
577 (^neutron_tempest_plugin.api)"
582 case_name: tempest_cinder_cntt
583 project_name: functest
589 This test case runs the Tempest suite proposed by the
594 mode: "(?!.*test_incremental_backup)\
595 (?!.*test_consistencygroups)\
596 (?!.*test_backup_crossproject_admin_negative)\
597 (?!.*test_backup_crossproject_user_negative)\
598 (^cinder_tempest_plugin.)"
603 case_name: tempest_keystone_cntt
604 project_name: functest
610 This test case runs the Tempest suite proposed by the
615 mode: "(?!.*api.identity.v3.test_oauth1_tokens)\
616 (?!.*scenario.test_federated_authentication)\
617 keystone_tempest_plugin."
622 case_name: tempest_heat_cntt
623 project_name: functest
629 This test case runs the Tempest suite proposed by the
634 mode: "(?!.*functional.test_lbaasv2)\
635 (?!.*functional.test_encryption_vol_type)\
636 (?!.*RemoteStackTest.test_stack_create_with_cloud_credential)\
637 (?!.*scenario.test_aodh_alarm)\
638 (?!.*tests.scenario.test_autoscaling_lb)\
639 (?!.*scenario.test_autoscaling_lbv2)\
640 (?!.*scenario.test_server_software_config)\
641 (?!.*test_volumes.VolumeBackupRestoreIntegrationTest)\
642 (?!.*scenario.test_octavia_lbaas)\
643 (?!.*scenario.test_server_cfn_init)\
644 ^heat_tempest_plugin.tests"
649 case_name: rally_sanity_cntt
650 project_name: functest
654 This test case runs a sub group of tests of the OpenStack
655 Rally suite in smoke mode.
671 case_name: tempest_full_cntt
672 project_name: functest
678 The list of test cases is generated by
679 Tempest automatically and depends on the parameters of
680 the OpenStack deployment.
681 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
685 mode: "(?!.*test_fixed_ips)\
686 (?!.*test_fixed_ips_negative)\
687 (?!.*test_auto_allocate_network)(?!.*test_floating_ips_bulk)\
688 (?!.*test_flavors_microversions.FlavorsV255TestJSON)\
689 (?!.*test_flavors_microversions.FlavorsV261TestJSON)\
690 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_iscsi_volume)\
691 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration)\
692 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration_paused)\
693 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_volume_backed_live_migration)\
694 (?!.*test_live_migration.LiveMigrationTest.test_iscsi_volume)\
695 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration)\
696 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration_paused)\
697 (?!.*test_live_migration.LiveMigrationTest.test_volume_backed_live_migration)\
698 (?!.*test_live_migration.LiveMigrationRemoteConsolesV26Test)\
699 (?!.*test_quotas.QuotasAdminTestV257)\
700 (?!.*certificates.test_certificates)\
701 (?!.*test_quotas_negative.QuotasSecurityGroupAdminNegativeTest)\
702 (?!.*test_novnc)(?!.*test_server_personality)\
703 (?!.*test_servers.ServerShowV263Test.test_show_update_rebuild_list_server)\
704 (?!.*test_servers_microversions.ServerShowV254Test)\
705 (?!.*test_servers_microversions.ServerShowV257Test)\
706 (?!.*test_servers_negative.ServersNegativeTestJSON.test_personality_file_contents_not_encoded)\
707 (?!.*servers.test_virtual_interfaces)\
708 (?!.*test_server_actions.ServerActionsTestJSON.test_change_server_password)\
709 (?!.*test_server_actions.ServerActionsTestJSON.test_get_vnc_console)\
710 (?!.*test_server_actions.ServerActionsTestJSON.test_reboot_server_soft)\
711 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
712 (?!.*test_server_rescue.ServerStableDeviceRescueTest)\
713 (?!.*test_security_group_default_rules)\
714 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_duplicate_name)\
715 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_description)\
716 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_name)\
717 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_des)\
718 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_id)\
719 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_name)\
720 (?!.*test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex)\
721 (?!.*compute.test_virtual_interfaces)(?!.*compute.test_virtual_interfaces_negative)\
722 (?!.*compute.test_networks)\
723 (?!.*test_attach_volume.AttachVolumeMultiAttach)\
724 (?!.*identity.admin.v2)(?!.*identity.v2)\
726 (?!.*image.v2.test_images.ImportImagesTest)\
727 (?!.*admin.test_dhcp_agent_scheduler)\
728 (?!.*admin.test_routers_dvr)\
729 (?!.*test_metering_extensions)(?!.*network.test_tags)\
730 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
731 (?!.*test_routers.RoutersIpV6Test.test_create_router_set_gateway_with_fixed_ip)\
732 (?!.*test_routers.RoutersTest.test_create_router_set_gateway_with_fixed_ip)\
733 (?!.*test_group_snapshots.GroupSnapshotsV319Test.test_reset_group_snapshot_status)\
734 (?!.*test_multi_backend)\
735 (?!.*test_volume_retype.VolumeRetypeWithMigrationTest)\
736 (?!.*test_volume_delete_cascade.VolumesDeleteCascade.test_volume_from_snapshot_cascade_delete)\
737 (?!.*test_volumes_backup.VolumesBackupsTest.test_volume_backup_create_get_detailed_list_restore_delete)\
738 (?!.*test_volumes_negative.UpdateMultiattachVolumeNegativeTest.test_multiattach_rw_volume_update_failure)\
739 (?!.*test_volumes_extend.VolumesExtendAttachedTest.test_extend_attached_volume)\
740 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.api)"
745 case_name: tempest_scenario_cntt
746 project_name: functest
752 The list of test cases is generated by
753 Tempest automatically and depends on the parameters of
754 the OpenStack deployment.
755 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
757 name: tempest_scenario
760 (?!.*test_volume_boot_pattern.TestVolumeBootPattern.test_boot_server_from_encrypted_volume_luks)\
761 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.scenario)"
766 case_name: tempest_slow_cntt
767 project_name: functest
773 The list of test cases is generated by
774 Tempest automatically and depends on the parameters of
775 the OpenStack deployment.
776 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
780 mode: "(?!.*test_volume_swap)\
781 (?!.*test_server_personality)\
782 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
783 (?!.*test_container_sync.ContainerSyncTest.test_container_synchronization)\
784 (?!.*test_container_sync_middleware.ContainerSyncMiddlewareTest.test_container_synchronization)\
785 (?!.*test_encrypted_cinder_volumes)\
786 (?!.*test_minbw_allocation_placement)\
787 (?!.*test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling)\
788 (?!.*test_volume_migrate_attached)\
789 (?!.*test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration_revert)\
790 (?=.*\\[.*\\bslow\\b.*\\])(^tempest.)"
797 Run several OpenStack performance tools
798 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
801 case_name: rally_full
802 project_name: functest
806 This test case runs the full suite of scenarios of the
807 OpenStack Rally suite using several threads and iterations.
816 case_name: rally_jobs
817 project_name: functest
821 This test case runs a group of Rally jobs used in
831 project_name: functest
835 VMTP is a small python application that will automatically
836 perform ping connectivity, round trip time measurement
837 (latency) and TCP/UDP throughput
839 - POD_ARCH: '^(?!aarch64$)'
845 project_name: functest
849 Shaker wraps around popular system network testing tools
850 like iperf, iperf3 and netperf (with help of flent). Shaker
851 is able to deploy OpenStack instances and networks in
852 different topologies.
854 - POD_ARCH: '^(?!aarch64$)'
859 name: benchmarking_cntt
861 Run several OpenStack performance tools
862 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
865 case_name: rally_full_cntt
866 project_name: functest
870 This test case runs the full suite of scenarios of the
871 OpenStack Rally suite using several threads and iterations.
887 case_name: rally_jobs_cntt
888 project_name: functest
892 This test case runs a group of Rally jobs used in
903 Collection of VNF test cases.
907 project_name: functest
911 This test case deploys the Cloudify orchestrator.
915 case_name: cloudify_ims
916 project_name: functest
920 This test case deploys an OpenSource vIMS solution from
921 Clearwater using the Cloudify orchestrator. It also runs
922 some signaling traffic.
924 - DEPLOY_SCENARIO: 'os-.*-nofeature-.*ha'
930 project_name: functest
934 This test case deploys an OpenSource vIMS solution from
935 Clearwater using the OpenStack Heat orchestrator.
936 It also runs some signaling traffic.
941 case_name: vyos_vrouter
942 project_name: functest
946 This test case is vRouter testing.
952 project_name: functest
956 vEPC validation with Juju as VNF manager and ABoT as test