6 First tier to be executed to verify the basic
10 case_name: connection_check
11 project_name: functest
15 This test case verifies the retrieval of OpenStack clients:
16 Keystone, Glance, Neutron and Nova and may perform some
19 name: connection_check
22 case_name: tenantnetwork1
23 project_name: functest
27 It creates and configures all tenant network ressources
28 required by advanced testcases (subnet, network and
31 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
36 case_name: tenantnetwork2
37 project_name: functest
41 It creates new user/project before creating and configuring
42 all tenant network ressources required by a testcase
43 (subnet, network and router).
45 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
51 project_name: functest
55 It inherits from TenantNetwork1 which creates all network
56 resources and prepares a future VM attached to that
63 project_name: functest
67 It creates new user/project before creating and configuring
68 all tenant network ressources, flavors, images, etc.
69 required by advanced testcases.
75 project_name: functest
79 It inherits from TenantNetwork1 which creates all network
80 resources and completes it by booting a VM attached to that
87 project_name: functest
91 It creates new user/project before creating and configuring
92 all tenant network ressources and vms required by advanced
99 project_name: functest
103 This test case verifies: 1) SSH to an instance using
104 floating IPs over the public network. 2) Connectivity
105 between 2 instances over a private network.
110 case_name: vping_userdata
111 project_name: functest
115 This test case verifies: 1) Boot a VM with given userdata.
116 2) Connectivity between 2 instances over a private network.
121 case_name: cinder_test
122 project_name: functest
126 This test case verifies: 1) Attach volume and to 1
127 instance; 2) Write data on volume 3) Detach volume
128 from instance 1, attach it on instance 2 3) Read volume
135 project_name: functest
139 Test Suite for the OpenDaylight SDN Controller. It
140 integrates some test suites from upstream using
141 Robot as the test framework.
143 - DEPLOY_SCENARIO: 'odl'
148 - /src/odl_test/csit/suites/integration/basic
149 - /src/odl_test/csit/suites/openstack/neutron
152 case_name: tempest_smoke
153 project_name: functest
157 This test case runs the smoke subset of the OpenStack
158 Tempest suite. The list of test cases is generated by
159 Tempest automatically and depends on the parameters of
160 the OpenStack deplopyment.
161 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L114
165 mode: '(?=.*\[.*\bsmoke\b.*\])(^tempest\.api)'
170 case_name: tempest_horizon
171 project_name: functest
175 This test case runs the Tempest suite proposed by the
178 - DASHBOARD_URL: '^(?!\s*$).+'
180 name: tempest_horizon
182 mode: '^tempest_horizon.'
187 Set of basic Functional tests to validate the OPNFV scenarios.
190 case_name: tempest_neutron
191 project_name: functest
195 This test case runs the Tempest suite proposed by the
196 Neutron project. The list of test cases is generated by
197 Tempest automatically and depends on the parameters of
198 the OpenStack deployment.
202 mode: '^neutron_tempest_plugin\.api'
207 case_name: tempest_cinder
208 project_name: functest
212 This test case runs the Tempest suite proposed by the
217 mode: "(?!.*test_incremental_backup)\
218 (?!.*test_backup_crossproject_admin_negative)\
219 (?!.*test_backup_crossproject_user_negative)\
220 (^cinder_tempest_plugin.)"
225 case_name: tempest_keystone
226 project_name: functest
230 This test case runs the Tempest suite proposed by the
235 mode: 'keystone_tempest_plugin.'
240 case_name: tempest_heat
241 project_name: functest
245 This test case runs the Tempest suite proposed by the
250 mode: '^heat_tempest_plugin.tests'
255 case_name: tempest_telemetry
256 project_name: functest
260 This test case runs the Tempest suite proposed by the
265 mode: "(?!.*test_autoscaling)(?!.*test_live)\
266 (^telemetry_tempest_plugin)"
275 case_name: rally_sanity
276 project_name: functest
280 This test case runs a sub group of tests of the OpenStack
281 Rally suite in smoke mode.
290 case_name: refstack_compute
291 project_name: functest
298 This test case runs a sub group of tests of the OpenStack
301 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
310 case_name: refstack_object
311 project_name: functest
317 This test case runs a sub group of tests of the OpenStack
327 case_name: refstack_platform
328 project_name: functest
335 This test case runs a sub group of tests of the OpenStack
338 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
347 case_name: tempest_full
348 project_name: functest
352 The list of test cases is generated by
353 Tempest automatically and depends on the parameters of
354 the OpenStack deployment.
355 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
359 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.api)'
364 case_name: tempest_scenario
365 project_name: functest
369 The list of test cases is generated by
370 Tempest automatically and depends on the parameters of
371 the OpenStack deployment.
372 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
376 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)'
381 case_name: tempest_slow
382 project_name: functest
386 The list of test cases is generated by
387 Tempest automatically and depends on the parameters of
388 the OpenStack deployment.
389 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
393 mode: '(?=.*\[.*\bslow\b.*\])(^tempest\.)'
398 case_name: patrole_admin
399 project_name: functest
403 Test suite from Patrole project.
408 mode: "(?!.*test_unmanage_snapshot_rbac)\
409 (?!.*test_show_auto_allocated_topology)\
410 (?!.*test_delete_auto_allocated_topology)\
411 (?!.*test_create_network_provider_segmentation_id)\
412 (?!.*compute.test_floating_ips_rbac)\
413 (?!.*test_reset_network)\
414 (?!.*test_create_image_from_volume_backed_server)\
415 (?=.*[.*\bslow\b.*])\
416 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
421 case_name: patrole_member
422 project_name: functest
426 Test suite from Patrole project.
431 mode: "(?!.*test_unmanage_snapshot_rbac)\
432 (?!.*test_show_auto_allocated_topology)\
433 (?!.*test_delete_auto_allocated_topology)\
434 (?!.*test_create_network_provider_segmentation_id)\
435 (?!.*compute.test_floating_ips_rbac)\
436 (?!.*test_reset_network)\
437 (?!.*test_create_image_from_volume_backed_server)\
438 (?=.*[.*\bslow\b.*])\
439 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
444 case_name: patrole_reader
445 project_name: functest
449 Test suite from Patrole project.
454 mode: "(?!.*test_unmanage_snapshot_rbac)\
455 (?!.*test_show_auto_allocated_topology)\
456 (?!.*test_delete_auto_allocated_topology)\
457 (?!.*test_create_network_provider_segmentation_id)\
458 (?!.*compute.test_floating_ips_rbac)\
459 (?!.*test_reset_network)\
460 (?!.*test_create_image_from_volume_backed_server)\
461 (?=.*[.*\bslow\b.*])\
462 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
467 case_name: tempest_barbican
468 project_name: functest
472 It leverages on the tempest plugin containing tests used to
473 verify the functionality of a barbican installation.
478 '^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$'
485 case_name: tempest_octavia
486 project_name: functest
490 It leverages on the tempest plugin containing tests used to
491 verify the functionality of an octavia installation.
495 mode: "(?!.*api.v2.test_availability_zone)\
496 (?!.*api.v2.test_availability_zone_profile)\
497 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv4_create)\
498 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv6_create)\
499 (^octavia_tempest_plugin.tests.(api|scenario))"
506 case_name: tempest_cyborg
507 project_name: functest
511 It leverages on the tempest plugin containing tests used to
512 verify the functionality of a cyborg installation.
516 mode: '^cyborg_tempest_plugin'
525 Set of basic Functional tests to validate the OPNFV scenarios.
528 case_name: tempest_neutron_cntt
529 project_name: functest
535 This test case runs the Tempest suite proposed by the
536 Neutron project. The list of test cases is generated by
537 Tempest automatically and depends on the parameters of
538 the OpenStack deployment.
542 mode: "(?!.*admin.test_agent_availability_zone)\
543 (?!.*admin.test_dhcp_agent_scheduler)\
544 (?!.*admin.test_l3_agent_scheduler)\
545 (?!.*admin.test_logging)\
546 (?!.*admin.test_logging_negative)\
547 (?!.*admin.test_network_segment_range)\
548 (?!.*admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address)\
549 (?!.*admin.test_ports.PortTestCasesResourceRequest)\
550 (?!.*admin.test_routers_dvr)\
551 (?!.*admin.test_routers_flavors)\
552 (?!.*admin.test_routers_ha)\
553 (?!.*test_conntrack_helper)\
554 (?!.*test_floating_ips.FloatingIPPoolTestJSON)\
555 (?!.*test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details)\
556 (?!.*test_metering_extensions)\
557 (?!.*test_metering_negative)\
558 (?!.*test_networks.NetworksSearchCriteriaTest.test_list_validation_filters)\
559 (?!.*test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan)\
560 (?!.*test_networks.NetworksTestJSON.test_create_update_network_dns_domain)\
561 (?!.*test_port_forwardings)\
562 (?!.*test_ports.PortsTaggingOnCreation)\
563 (?!.*test_ports.PortsTestJSON.test_create_port_with_propagate_uplink_status)\
564 (?!.*test_ports.PortsTestJSON.test_create_port_without_propagate_uplink_status)\
565 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_domain)\
566 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_name)\
567 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name)\
568 (?!.*test_qos.QosMinimumBandwidthRuleTestJSON)\
569 (?!.*test_revisions.TestRevisions.test_update_dns_domain_bumps_revision)\
570 (?!.*test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision)\
571 (?!.*test_router_interface_fip)\
572 (?!.*test_routers.DvrRoutersTest)\
573 (?!.*test_routers.HaRoutersTest)\
574 (?!.*test_routers.RoutersIpV6Test.test_extra_routes_atomic)\
575 (?!.*test_routers.RoutersTest.test_extra_routes_atomic)\
576 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
577 (?!.*test_routers_negative.DvrRoutersNegativeTestExtended)\
578 (?!.*test_routers_negative.HaRoutersNegativeTest)\
579 (?!.*test_security_groups.RbacSharedSecurityGroupTest)\
580 (?!.*test_subnetpool_prefix_ops)\
581 (?!.*test_subnetpools.RbacSubnetPoolTest)\
582 (?!.*test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters)\
583 (?!.*test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_subnetpool_associate_shared_address_scope)\
584 (?!.*test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters)\
585 (?!.*test_timestamp.TestTimeStamp.test_segment_with_timestamp)\
586 (?!.*test_trunk.TrunkTestInheritJSONBase.test_add_subport)\
587 (?!.*test_trunk.TrunkTestMtusJSON)\
588 (?!.*test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type)\
589 (?!.*test_trunk_negative.TrunkTestMtusJSON)\
590 (^neutron_tempest_plugin.api)"
595 case_name: tempest_cinder_cntt
596 project_name: functest
602 This test case runs the Tempest suite proposed by the
607 mode: "(?!.*test_incremental_backup)\
608 (?!.*test_consistencygroups)\
609 (?!.*test_backup_crossproject_admin_negative)\
610 (?!.*test_backup_crossproject_user_negative)\
611 (^cinder_tempest_plugin.)"
616 case_name: tempest_keystone_cntt
617 project_name: functest
623 This test case runs the Tempest suite proposed by the
628 mode: "(?!.*api.identity.v3.test_oauth1_tokens)\
629 (?!.*scenario.test_federated_authentication)\
630 keystone_tempest_plugin."
635 case_name: tempest_heat_cntt
636 project_name: functest
642 This test case runs the Tempest suite proposed by the
647 mode: "(?!.*functional.test_lbaasv2)\
648 (?!.*functional.test_encryption_vol_type)\
649 (?!.*RemoteStackTest.test_stack_create_with_cloud_credential)\
650 (?!.*scenario.test_aodh_alarm)\
651 (?!.*tests.scenario.test_autoscaling_lb)\
652 (?!.*scenario.test_autoscaling_lbv2)\
653 (?!.*scenario.test_server_software_config)\
654 (?!.*test_volumes.VolumeBackupRestoreIntegrationTest)\
655 (?!.*scenario.test_octavia_lbaas)\
656 (?!.*scenario.test_server_cfn_init)\
657 ^heat_tempest_plugin.tests"
662 case_name: rally_sanity_cntt
663 project_name: functest
667 This test case runs a sub group of tests of the OpenStack
668 Rally suite in smoke mode.
684 case_name: tempest_full_cntt
685 project_name: functest
691 The list of test cases is generated by
692 Tempest automatically and depends on the parameters of
693 the OpenStack deployment.
694 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
698 mode: "(?!.*admin.test_agents)(?!.*test_fixed_ips)\
699 (?!.*test_fixed_ips_negative)\
700 (?!.*test_auto_allocate_network)(?!.*test_floating_ips_bulk)\
701 (?!.*test_flavors_microversions.FlavorsV255TestJSON)\
702 (?!.*test_flavors_microversions.FlavorsV261TestJSON)\
703 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_iscsi_volume)\
704 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration)\
705 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration_paused)\
706 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_volume_backed_live_migration)\
707 (?!.*test_live_migration.LiveMigrationTest.test_iscsi_volume)\
708 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration)\
709 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration_paused)\
710 (?!.*test_live_migration.LiveMigrationTest.test_volume_backed_live_migration)\
711 (?!.*test_live_migration.LiveMigrationRemoteConsolesV26Test)\
712 (?!.*test_quotas.QuotasAdminTestV257)\
713 (?!.*test_servers.ServersAdminTestJSON.test_reset_network_inject_network_info)\
714 (?!.*certificates.test_certificates)\
715 (?!.*test_quotas_negative.QuotasSecurityGroupAdminNegativeTest)\
716 (?!.*test_novnc)(?!.*test_server_personality)\
717 (?!.*test_servers.ServerShowV263Test.test_show_update_rebuild_list_server)\
718 (?!.*test_servers_microversions.ServerShowV254Test)\
719 (?!.*test_servers_microversions.ServerShowV257Test)\
720 (?!.*test_servers_negative.ServersNegativeTestJSON.test_personality_file_contents_not_encoded)\
721 (?!.*servers.test_virtual_interfaces)\
722 (?!.*test_server_actions.ServerActionsTestJSON.test_change_server_password)\
723 (?!.*test_server_actions.ServerActionsTestJSON.test_get_vnc_console)\
724 (?!.*test_server_actions.ServerActionsTestJSON.test_reboot_server_soft)\
725 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
726 (?!.*test_server_rescue.ServerStableDeviceRescueTest)\
727 (?!.*test_security_group_default_rules)\
728 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_duplicate_name)\
729 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_description)\
730 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_name)\
731 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_des)\
732 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_id)\
733 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_name)\
734 (?!.*test_server_metadata.ServerMetadataTestJSON)\
735 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_delete_metadata_non_existent_server)\
736 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_metadata_items_limit)\
737 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_metadata_invalid_key)\
738 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_metadata_non_existent_server)\
739 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_server_metadata_blank_key)\
740 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_server_metadata_missing_metadata)\
741 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_update_metadata_non_existent_server)\
742 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_update_metadata_with_blank_key)\
743 (?!.*test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex)\
744 (?!.*compute.test_virtual_interfaces)(?!.*compute.test_virtual_interfaces_negative)\
745 (?!.*compute.test_networks)\
746 (?!.*test_attach_volume.AttachVolumeMultiAttach)\
747 (?!.*identity.admin.v2)(?!.*identity.v2)\
748 (?!.*identity.v3.test_access_rules)\
749 (?!.*identity.v3.test_application_credentials.ApplicationCredentialsV3Test.test_create_application_credential_access_rules)\
751 (?!.*image.v2.admin.test_images.ImportCopyImagesTest)\
752 (?!.*image.v2.test_images.ImportImagesTest)\
753 (?!.*image.v2.test_images.MultiStoresImportImages)\
754 (?!.*admin.test_dhcp_agent_scheduler)\
755 (?!.*admin.test_routers_dvr)\
756 (?!.*test_metering_extensions)(?!.*network.test_tags)\
757 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
758 (?!.*test_routers.RoutersIpV6Test.test_create_router_set_gateway_with_fixed_ip)\
759 (?!.*test_routers.RoutersTest.test_create_router_set_gateway_with_fixed_ip)\
760 (?!.*test_encrypted_volumes_extend)\
761 (?!.*test_group_snapshots.GroupSnapshotsV319Test.test_reset_group_snapshot_status)\
762 (?!.*test_multi_backend)\
763 (?!.*test_volume_retype.VolumeRetypeWithMigrationTest)\
764 (?!.*test_volume_delete_cascade.VolumesDeleteCascade.test_volume_from_snapshot_cascade_delete)\
765 (?!.*test_volumes_backup.VolumesBackupsTest.test_volume_backup_create_get_detailed_list_restore_delete)\
766 (?!.*test_volumes_negative.UpdateMultiattachVolumeNegativeTest.test_multiattach_rw_volume_update_failure)\
767 (?!.*test_volumes_extend.VolumesExtendAttachedTest.test_extend_attached_volume)\
768 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.api)"
773 case_name: tempest_scenario_cntt
774 project_name: functest
780 The list of test cases is generated by
781 Tempest automatically and depends on the parameters of
782 the OpenStack deployment.
783 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
785 name: tempest_scenario
788 (?!.*test_volume_boot_pattern.TestVolumeBootPattern.test_boot_server_from_encrypted_volume_luks)\
789 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.scenario)"
794 case_name: tempest_slow_cntt
795 project_name: functest
801 The list of test cases is generated by
802 Tempest automatically and depends on the parameters of
803 the OpenStack deployment.
804 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
808 mode: "(?!.*test_volume_swap)\
809 (?!.*test_server_personality)\
810 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
811 (?!.*test_container_sync.ContainerSyncTest.test_container_synchronization)\
812 (?!.*test_container_sync_middleware.ContainerSyncMiddlewareTest.test_container_synchronization)\
813 (?!.*test_encrypted_cinder_volumes)\
814 (?!.*test_minbw_allocation_placement)\
815 (?!.*test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling)\
816 (?!.*test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance)\
817 (?!.*test_volume_migrate_attached)\
818 (?!.*test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration_revert)\
819 (?=.*\\[.*\\bslow\\b.*\\])(^tempest.)"
826 Run several OpenStack performance tools
827 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
830 case_name: rally_full
831 project_name: functest
835 This test case runs the full suite of scenarios of the
836 OpenStack Rally suite using several threads and iterations.
845 case_name: rally_jobs
846 project_name: functest
850 This test case runs a group of Rally jobs used in
860 project_name: functest
864 VMTP is a small python application that will automatically
865 perform ping connectivity, round trip time measurement
866 (latency) and TCP/UDP throughput
868 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
874 project_name: functest
878 Shaker wraps around popular system network testing tools
879 like iperf, iperf3 and netperf (with help of flent). Shaker
880 is able to deploy OpenStack instances and networks in
881 different topologies.
883 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
888 name: benchmarking_cntt
890 Run several OpenStack performance tools
891 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
894 case_name: rally_full_cntt
895 project_name: functest
899 This test case runs the full suite of scenarios of the
900 OpenStack Rally suite using several threads and iterations.
916 case_name: rally_jobs_cntt
917 project_name: functest
921 This test case runs a group of Rally jobs used in
932 Collection of VNF test cases.
936 project_name: functest
940 This test case deploys the Cloudify orchestrator.
944 case_name: cloudify_ims
945 project_name: functest
949 This test case deploys an OpenSource vIMS solution from
950 Clearwater using the Cloudify orchestrator. It also runs
951 some signaling traffic.
953 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
959 project_name: functest
963 This test case deploys an OpenSource vIMS solution from
964 Clearwater using the OpenStack Heat orchestrator.
965 It also runs some signaling traffic.
967 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
972 case_name: vyos_vrouter
973 project_name: functest
977 This test case is vRouter testing.
979 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
985 project_name: functest
989 vEPC validation with Juju as VNF manager and ABoT as test
992 - NO_TENANT_NETWORK: '^(?![tT]rue$)'