6 First tier to be executed to verify the basic
10 case_name: connection_check
11 project_name: functest
15 This test case verifies the retrieval of OpenStack clients:
16 Keystone, Glance, Neutron and Nova and may perform some
19 name: connection_check
22 case_name: tenantnetwork1
23 project_name: functest
27 It creates and configures all tenant network ressources
28 required by advanced testcases (subnet, network and
34 case_name: tenantnetwork2
35 project_name: functest
39 It creates new user/project before creating and configuring
40 all tenant network ressources required by a testcase
41 (subnet, network and router).
47 project_name: functest
51 It inherits from TenantNetwork1 which creates all network
52 resources and prepares a future VM attached to that
59 project_name: functest
63 It creates new user/project before creating and configuring
64 all tenant network ressources, flavors, images, etc.
65 required by advanced testcases.
71 project_name: functest
75 It inherits from TenantNetwork1 which creates all network
76 resources and completes it by booting a VM attached to that
83 project_name: functest
87 It creates new user/project before creating and configuring
88 all tenant network ressources and vms required by advanced
95 project_name: functest
99 This test case verifies: 1) SSH to an instance using
100 floating IPs over the public network. 2) Connectivity
101 between 2 instances over a private network.
106 case_name: vping_userdata
107 project_name: functest
111 This test case verifies: 1) Boot a VM with given userdata.
112 2) Connectivity between 2 instances over a private network.
117 case_name: cinder_test
118 project_name: functest
122 This test case verifies: 1) Attach volume and to 1
123 instance; 2) Write data on volume 3) Detach volume
124 from instance 1, attach it on instance 2 3) Read volume
131 project_name: functest
135 Test Suite for the OpenDaylight SDN Controller. It
136 integrates some test suites from upstream using
137 Robot as the test framework.
139 - DEPLOY_SCENARIO: 'odl'
144 - /src/odl_test/csit/suites/integration/basic
145 - /src/odl_test/csit/suites/openstack/neutron
148 case_name: tempest_smoke
149 project_name: functest
153 This test case runs the smoke subset of the OpenStack
154 Tempest suite. The list of test cases is generated by
155 Tempest automatically and depends on the parameters of
156 the OpenStack deplopyment.
157 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L114
161 mode: '(?=.*\[.*\bsmoke\b.*\])(^tempest\.api)'
166 case_name: tempest_horizon
167 project_name: functest
171 This test case runs the Tempest suite proposed by the
174 - DASHBOARD_URL: '^(?!\s*$).+'
176 name: tempest_horizon
178 mode: '^tempest_horizon.'
183 Set of basic Functional tests to validate the OPNFV scenarios.
186 case_name: tempest_neutron
187 project_name: functest
191 This test case runs the Tempest suite proposed by the
192 Neutron project. The list of test cases is generated by
193 Tempest automatically and depends on the parameters of
194 the OpenStack deployment.
198 mode: '^neutron_tempest_plugin\.api'
203 case_name: tempest_cinder
204 project_name: functest
208 This test case runs the Tempest suite proposed by the
213 mode: "(?!.*test_incremental_backup)\
214 (?!.*test_backup_crossproject_admin_negative)\
215 (?!.*test_backup_crossproject_user_negative)\
216 (^cinder_tempest_plugin.)"
221 case_name: tempest_keystone
222 project_name: functest
226 This test case runs the Tempest suite proposed by the
231 mode: 'keystone_tempest_plugin.'
236 case_name: tempest_heat
237 project_name: functest
241 This test case runs the Tempest suite proposed by the
246 mode: '^heat_tempest_plugin.tests'
251 case_name: tempest_telemetry
252 project_name: functest
256 This test case runs the Tempest suite proposed by the
261 mode: "(?!.*test_autoscaling)(?!.*test_live)\
262 (^telemetry_tempest_plugin)"
271 case_name: rally_sanity
272 project_name: functest
276 This test case runs a sub group of tests of the OpenStack
277 Rally suite in smoke mode.
286 case_name: refstack_compute
287 project_name: functest
293 This test case runs a sub group of tests of the OpenStack
303 case_name: refstack_object
304 project_name: functest
310 This test case runs a sub group of tests of the OpenStack
320 case_name: refstack_platform
321 project_name: functest
327 This test case runs a sub group of tests of the OpenStack
337 case_name: tempest_full
338 project_name: functest
342 The list of test cases is generated by
343 Tempest automatically and depends on the parameters of
344 the OpenStack deployment.
345 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
349 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.api)'
354 case_name: tempest_scenario
355 project_name: functest
359 The list of test cases is generated by
360 Tempest automatically and depends on the parameters of
361 the OpenStack deployment.
362 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
366 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)'
371 case_name: tempest_slow
372 project_name: functest
376 The list of test cases is generated by
377 Tempest automatically and depends on the parameters of
378 the OpenStack deployment.
379 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
383 mode: '(?=.*\[.*\bslow\b.*\])(^tempest\.)'
388 case_name: patrole_admin
389 project_name: functest
393 Test suite from Patrole project.
398 mode: "(?!.*test_unmanage_snapshot_rbac)\
399 (?!.*test_show_auto_allocated_topology)\
400 (?!.*test_delete_auto_allocated_topology)\
401 (?!.*compute.test_floating_ips_rbac)\
402 (?=.*[.*\bslow\b.*])\
403 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
408 case_name: patrole_member
409 project_name: functest
413 Test suite from Patrole project.
418 mode: "(?!.*test_unmanage_snapshot_rbac)\
419 (?!.*test_show_auto_allocated_topology)\
420 (?!.*test_delete_auto_allocated_topology)\
421 (?!.*compute.test_floating_ips_rbac)\
422 (?=.*[.*\bslow\b.*])\
423 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
428 case_name: patrole_reader
429 project_name: functest
433 Test suite from Patrole project.
438 mode: "(?!.*test_unmanage_snapshot_rbac)\
439 (?!.*test_show_auto_allocated_topology)\
440 (?!.*test_delete_auto_allocated_topology)\
441 (?!.*compute.test_floating_ips_rbac)\
442 (?=.*[.*\bslow\b.*])\
443 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
448 case_name: tempest_barbican
449 project_name: functest
453 It leverages on the tempest plugin containing tests used to
454 verify the functionality of a barbican installation.
459 '^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$'
466 case_name: tempest_octavia
467 project_name: functest
471 It leverages on the tempest plugin containing tests used to
472 verify the functionality of an octavia installation.
476 mode: "(?!.*api.v2.test_availability_zone)\
477 (?!.*api.v2.test_availability_zone_profile)\
478 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv4_create)\
479 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv6_create)\
480 (^octavia_tempest_plugin.tests.(api|scenario))"
487 case_name: tempest_cyborg
488 project_name: functest
492 It leverages on the tempest plugin containing tests used to
493 verify the functionality of a cyborg installation.
497 mode: '^cyborg_tempest_plugin'
506 Set of basic Functional tests to validate the OPNFV scenarios.
509 case_name: tempest_neutron_cntt
510 project_name: functest
516 This test case runs the Tempest suite proposed by the
517 Neutron project. The list of test cases is generated by
518 Tempest automatically and depends on the parameters of
519 the OpenStack deployment.
523 mode: "(?!.*admin.test_agent_availability_zone)\
524 (?!.*admin.test_dhcp_agent_scheduler)\
525 (?!.*admin.test_l3_agent_scheduler)\
526 (?!.*admin.test_logging)\
527 (?!.*admin.test_logging_negative)\
528 (?!.*admin.test_network_segment_range)\
529 (?!.*admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address)\
530 (?!.*admin.test_ports.PortTestCasesResourceRequest)\
531 (?!.*admin.test_routers_dvr)\
532 (?!.*admin.test_routers_flavors)\
533 (?!.*admin.test_routers_ha)\
534 (?!.*test_conntrack_helper)\
535 (?!.*test_floating_ips.FloatingIPPoolTestJSON)\
536 (?!.*test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details)\
537 (?!.*test_metering_extensions)\
538 (?!.*test_metering_negative)\
539 (?!.*test_networks.NetworksSearchCriteriaTest.test_list_validation_filters)\
540 (?!.*test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan)\
541 (?!.*test_networks.NetworksTestJSON.test_create_update_network_dns_domain)\
542 (?!.*test_port_forwardings)\
543 (?!.*test_ports.PortsTaggingOnCreation)\
544 (?!.*test_ports.PortsTestJSON.test_create_port_with_propagate_uplink_status)\
545 (?!.*test_ports.PortsTestJSON.test_create_port_without_propagate_uplink_status)\
546 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_domain)\
547 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_name)\
548 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name)\
549 (?!.*test_qos.QosMinimumBandwidthRuleTestJSON)\
550 (?!.*test_revisions.TestRevisions.test_update_dns_domain_bumps_revision)\
551 (?!.*test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision)\
552 (?!.*test_router_interface_fip)\
553 (?!.*test_routers.DvrRoutersTest)\
554 (?!.*test_routers.HaRoutersTest)\
555 (?!.*test_routers.RoutersIpV6Test.test_extra_routes_atomic)\
556 (?!.*test_routers.RoutersTest.test_extra_routes_atomic)\
557 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
558 (?!.*test_routers_negative.DvrRoutersNegativeTestExtended)\
559 (?!.*test_routers_negative.HaRoutersNegativeTest)\
560 (?!.*test_security_groups.RbacSharedSecurityGroupTest)\
561 (?!.*test_subnetpool_prefix_ops)\
562 (?!.*test_subnetpools.RbacSubnetPoolTest)\
563 (?!.*test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters)\
564 (?!.*test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_subnetpool_associate_shared_address_scope)\
565 (?!.*test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters)\
566 (?!.*test_timestamp.TestTimeStamp.test_segment_with_timestamp)\
567 (?!.*test_trunk.TrunkTestInheritJSONBase.test_add_subport)\
568 (?!.*test_trunk.TrunkTestMtusJSON)\
569 (?!.*test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type)\
570 (?!.*test_trunk_negative.TrunkTestMtusJSON)\
571 (^neutron_tempest_plugin.api)"
576 case_name: tempest_cinder_cntt
577 project_name: functest
583 This test case runs the Tempest suite proposed by the
588 mode: "(?!.*test_incremental_backup)\
589 (?!.*test_consistencygroups)\
590 (?!.*test_backup_crossproject_admin_negative)\
591 (?!.*test_backup_crossproject_user_negative)\
592 (^cinder_tempest_plugin.)"
597 case_name: tempest_keystone_cntt
598 project_name: functest
604 This test case runs the Tempest suite proposed by the
609 mode: "(?!.*api.identity.v3.test_oauth1_tokens)\
610 (?!.*scenario.test_federated_authentication)\
611 keystone_tempest_plugin."
616 case_name: tempest_heat_cntt
617 project_name: functest
623 This test case runs the Tempest suite proposed by the
628 mode: "(?!.*functional.test_lbaasv2)\
629 (?!.*functional.test_encryption_vol_type)\
630 (?!.*RemoteStackTest.test_stack_create_with_cloud_credential)\
631 (?!.*scenario.test_aodh_alarm)\
632 (?!.*tests.scenario.test_autoscaling_lb)\
633 (?!.*scenario.test_autoscaling_lbv2)\
634 (?!.*scenario.test_server_software_config)\
635 (?!.*test_volumes.VolumeBackupRestoreIntegrationTest)\
636 (?!.*scenario.test_octavia_lbaas)\
637 (?!.*scenario.test_server_cfn_init)\
638 ^heat_tempest_plugin.tests"
643 case_name: rally_sanity_cntt
644 project_name: functest
648 This test case runs a sub group of tests of the OpenStack
649 Rally suite in smoke mode.
665 case_name: tempest_full_cntt
666 project_name: functest
672 The list of test cases is generated by
673 Tempest automatically and depends on the parameters of
674 the OpenStack deployment.
675 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
679 mode: "(?!.*test_fixed_ips)\
680 (?!.*test_fixed_ips_negative)\
681 (?!.*test_auto_allocate_network)(?!.*test_floating_ips_bulk)\
682 (?!.*test_flavors_microversions.FlavorsV255TestJSON)\
683 (?!.*test_flavors_microversions.FlavorsV261TestJSON)\
684 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_iscsi_volume)\
685 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration)\
686 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration_paused)\
687 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_volume_backed_live_migration)\
688 (?!.*test_live_migration.LiveMigrationTest.test_iscsi_volume)\
689 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration)\
690 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration_paused)\
691 (?!.*test_live_migration.LiveMigrationTest.test_volume_backed_live_migration)\
692 (?!.*test_live_migration.LiveMigrationRemoteConsolesV26Test)\
693 (?!.*test_quotas.QuotasAdminTestV257)\
694 (?!.*certificates.test_certificates)\
695 (?!.*test_quotas_negative.QuotasSecurityGroupAdminNegativeTest)\
696 (?!.*test_novnc)(?!.*test_server_personality)\
697 (?!.*test_servers.ServerShowV263Test.test_show_update_rebuild_list_server)\
698 (?!.*test_servers_microversions.ServerShowV254Test)\
699 (?!.*test_servers_microversions.ServerShowV257Test)\
700 (?!.*test_servers_negative.ServersNegativeTestJSON.test_personality_file_contents_not_encoded)\
701 (?!.*servers.test_virtual_interfaces)\
702 (?!.*test_server_actions.ServerActionsTestJSON.test_change_server_password)\
703 (?!.*test_server_actions.ServerActionsTestJSON.test_get_vnc_console)\
704 (?!.*test_server_actions.ServerActionsTestJSON.test_reboot_server_soft)\
705 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
706 (?!.*test_server_rescue.ServerStableDeviceRescueTest)\
707 (?!.*test_security_group_default_rules)\
708 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_duplicate_name)\
709 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_description)\
710 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_name)\
711 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_des)\
712 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_id)\
713 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_name)\
714 (?!.*test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex)\
715 (?!.*compute.test_virtual_interfaces)(?!.*compute.test_virtual_interfaces_negative)\
716 (?!.*compute.test_networks)\
717 (?!.*test_attach_volume.AttachVolumeMultiAttach)\
718 (?!.*identity.admin.v2)(?!.*identity.v2)\
720 (?!.*image.v2.test_images.ImportImagesTest)\
721 (?!.*admin.test_dhcp_agent_scheduler)\
722 (?!.*admin.test_routers_dvr)\
723 (?!.*test_metering_extensions)(?!.*network.test_tags)\
724 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
725 (?!.*test_routers.RoutersIpV6Test.test_create_router_set_gateway_with_fixed_ip)\
726 (?!.*test_routers.RoutersTest.test_create_router_set_gateway_with_fixed_ip)\
727 (?!.*test_group_snapshots.GroupSnapshotsV319Test.test_reset_group_snapshot_status)\
728 (?!.*test_multi_backend)\
729 (?!.*test_volume_retype.VolumeRetypeWithMigrationTest)\
730 (?!.*test_volume_delete_cascade.VolumesDeleteCascade.test_volume_from_snapshot_cascade_delete)\
731 (?!.*test_volumes_backup.VolumesBackupsTest.test_volume_backup_create_get_detailed_list_restore_delete)\
732 (?!.*test_volumes_negative.UpdateMultiattachVolumeNegativeTest.test_multiattach_rw_volume_update_failure)\
733 (?!.*test_volumes_extend.VolumesExtendAttachedTest.test_extend_attached_volume)\
734 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.api)"
739 case_name: tempest_scenario_cntt
740 project_name: functest
746 The list of test cases is generated by
747 Tempest automatically and depends on the parameters of
748 the OpenStack deployment.
749 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
751 name: tempest_scenario
754 (?!.*test_volume_boot_pattern.TestVolumeBootPattern.test_boot_server_from_encrypted_volume_luks)\
755 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.scenario)"
760 case_name: tempest_slow_cntt
761 project_name: functest
767 The list of test cases is generated by
768 Tempest automatically and depends on the parameters of
769 the OpenStack deployment.
770 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
774 mode: "(?!.*test_volume_swap)\
775 (?!.*test_server_personality)\
776 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
777 (?!.*test_container_sync.ContainerSyncTest.test_container_synchronization)\
778 (?!.*test_container_sync_middleware.ContainerSyncMiddlewareTest.test_container_synchronization)\
779 (?!.*test_encrypted_cinder_volumes)\
780 (?!.*test_minbw_allocation_placement)\
781 (?!.*test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling)\
782 (?!.*test_volume_migrate_attached)\
783 (?!.*test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration_revert)\
784 (?=.*\\[.*\\bslow\\b.*\\])(^tempest.)"
791 Run several OpenStack performance tools
792 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
795 case_name: rally_full
796 project_name: functest
800 This test case runs the full suite of scenarios of the
801 OpenStack Rally suite using several threads and iterations.
810 case_name: rally_jobs
811 project_name: functest
815 This test case runs a group of Rally jobs used in
825 project_name: functest
829 VMTP is a small python application that will automatically
830 perform ping connectivity, round trip time measurement
831 (latency) and TCP/UDP throughput
833 - POD_ARCH: '^(?!aarch64$)'
839 project_name: functest
843 Shaker wraps around popular system network testing tools
844 like iperf, iperf3 and netperf (with help of flent). Shaker
845 is able to deploy OpenStack instances and networks in
846 different topologies.
848 - POD_ARCH: '^(?!aarch64$)'
853 name: benchmarking_cntt
855 Run several OpenStack performance tools
856 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
859 case_name: rally_full_cntt
860 project_name: functest
864 This test case runs the full suite of scenarios of the
865 OpenStack Rally suite using several threads and iterations.
881 case_name: rally_jobs_cntt
882 project_name: functest
886 This test case runs a group of Rally jobs used in
897 Collection of VNF test cases.
901 project_name: functest
905 This test case deploys the Cloudify orchestrator.
909 case_name: cloudify_ims
910 project_name: functest
914 This test case deploys an OpenSource vIMS solution from
915 Clearwater using the Cloudify orchestrator. It also runs
916 some signaling traffic.
918 - DEPLOY_SCENARIO: 'os-.*-nofeature-.*ha'
924 project_name: functest
928 This test case deploys an OpenSource vIMS solution from
929 Clearwater using the OpenStack Heat orchestrator.
930 It also runs some signaling traffic.
935 case_name: vyos_vrouter
936 project_name: functest
940 This test case is vRouter testing.
946 project_name: functest
950 vEPC validation with Juju as VNF manager and ABoT as test