6 First tier to be executed to verify the basic
10 case_name: connection_check
11 project_name: functest
15 This test case verifies the retrieval of OpenStack clients:
16 Keystone, Glance, Neutron and Nova and may perform some
19 name: connection_check
22 case_name: tenantnetwork1
23 project_name: functest
27 It creates and configures all tenant network ressources
28 required by advanced testcases (subnet, network and
31 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
36 case_name: tenantnetwork2
37 project_name: functest
41 It creates new user/project before creating and configuring
42 all tenant network ressources required by a testcase
43 (subnet, network and router).
45 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
51 project_name: functest
55 It inherits from TenantNetwork1 which creates all network
56 resources and prepares a future VM attached to that
63 project_name: functest
67 It creates new user/project before creating and configuring
68 all tenant network ressources, flavors, images, etc.
69 required by advanced testcases.
75 project_name: functest
79 It inherits from TenantNetwork1 which creates all network
80 resources and completes it by booting a VM attached to that
87 project_name: functest
91 It creates new user/project before creating and configuring
92 all tenant network ressources and vms required by advanced
99 project_name: functest
103 This test case verifies: 1) SSH to an instance using
104 floating IPs over the public network. 2) Connectivity
105 between 2 instances over a private network.
110 case_name: vping_userdata
111 project_name: functest
115 This test case verifies: 1) Boot a VM with given userdata.
116 2) Connectivity between 2 instances over a private network.
121 case_name: cinder_test
122 project_name: functest
126 This test case verifies: 1) Attach volume and to 1
127 instance; 2) Write data on volume 3) Detach volume
128 from instance 1, attach it on instance 2 3) Read volume
135 project_name: functest
139 Test Suite for the OpenDaylight SDN Controller. It
140 integrates some test suites from upstream using
141 Robot as the test framework.
143 - DEPLOY_SCENARIO: 'odl'
148 - /src/odl_test/csit/suites/integration/basic
149 - /src/odl_test/csit/suites/openstack/neutron
152 case_name: tempest_smoke
153 project_name: functest
157 This test case runs the smoke subset of the OpenStack
158 Tempest suite. The list of test cases is generated by
159 Tempest automatically and depends on the parameters of
160 the OpenStack deplopyment.
161 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L114
165 mode: '(?=.*\[.*\bsmoke\b.*\])(^tempest\.api)'
170 case_name: tempest_horizon
171 project_name: functest
175 This test case runs the Tempest suite proposed by the
178 - DASHBOARD_URL: '^(?!\s*$).+'
182 mode: '^tempest.scenario.test_dashboard_basic_ops.'
187 Set of basic Functional tests to validate the OPNFV scenarios.
190 case_name: tempest_neutron
191 project_name: functest
195 This test case runs the Tempest suite proposed by the
196 Neutron project. The list of test cases is generated by
197 Tempest automatically and depends on the parameters of
198 the OpenStack deployment.
202 mode: '^neutron_tempest_plugin\.api'
207 case_name: tempest_cinder
208 project_name: functest
212 This test case runs the Tempest suite proposed by the
217 mode: "(?!.*test_incremental_backup)\
218 (?!.*test_backup_crossproject_admin_negative)\
219 (?!.*test_backup_crossproject_user_negative)\
220 (^cinder_tempest_plugin.)"
225 case_name: tempest_keystone
226 project_name: functest
230 This test case runs the Tempest suite proposed by the
235 mode: 'keystone_tempest_plugin.'
240 case_name: tempest_heat
241 project_name: functest
245 This test case runs the Tempest suite proposed by the
250 mode: '^heat_tempest_plugin.tests'
255 case_name: tempest_telemetry
256 project_name: functest
260 This test case runs the Tempest suite proposed by the
265 mode: "(?!.*test_autoscaling)(?!.*test_live)\
266 (^telemetry_tempest_plugin)"
275 case_name: rally_sanity
276 project_name: functest
280 This test case runs a sub group of tests of the OpenStack
281 Rally suite in smoke mode.
290 case_name: refstack_compute
291 project_name: functest
295 This test case runs a sub group of tests of the OpenStack
298 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
307 case_name: refstack_object
308 project_name: functest
314 This test case runs a sub group of tests of the OpenStack
324 case_name: refstack_platform
325 project_name: functest
329 This test case runs a sub group of tests of the OpenStack
332 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
341 case_name: tempest_full
342 project_name: functest
346 The list of test cases is generated by
347 Tempest automatically and depends on the parameters of
348 the OpenStack deployment.
349 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
353 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.api)'
358 case_name: tempest_scenario
359 project_name: functest
363 The list of test cases is generated by
364 Tempest automatically and depends on the parameters of
365 the OpenStack deployment.
366 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
370 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)'
375 case_name: tempest_slow
376 project_name: functest
380 The list of test cases is generated by
381 Tempest automatically and depends on the parameters of
382 the OpenStack deployment.
383 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
387 mode: '(?=.*\[.*\bslow\b.*\])(^tempest\.)'
392 case_name: patrole_admin
393 project_name: functest
397 Test suite from Patrole project.
402 mode: "(?!.*test_unmanage_snapshot_rbac)\
403 (?!.*test_show_auto_allocated_topology)\
404 (?!.*test_delete_auto_allocated_topology)\
405 (?!.*test_create_network_provider_segmentation_id)\
406 (?!.*compute.test_floating_ips_rbac)\
407 (?!.*test_reset_network)\
408 (?!.*test_create_image_from_volume_backed_server)\
409 (?!.*test_network_ip_availability_rbac.NetworkIpAvailabilityExtRbacTest.test_get_network_ip_availabilities)\
410 (?!.*test_policy_bandwidth_limit_rule_rbac)\
411 (?!.*test_policy_minimum_bandwidth_rule_rbac)\
412 (?!.*test_group_type_specs)\
413 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_create_group_type)\
414 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_delete_group_type)\
415 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_update_group_type)\
416 (?!.*test_group_snapshots_rbac)\
417 (?!.*test_groups_rbac)\
418 (?!.*test_quota_classes_rbac)\
419 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_create_interface)\
420 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_delete_interface)\
421 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_show_interface)\
422 (?!.*test_user_messages_rbac)\
423 (?!.*test_volume_actions_rbac.VolumesActionsV310RbacTest)\
424 (?!.*test_volume_actions_rbac.VolumesActionsV312RbacTest)\
425 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_delete_volume_image_metadata)\
426 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_list_volumes_details_image_metadata)\
427 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_show_volume_details_image_metadata)\
428 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_update_volume_image_metadata)\
429 (?!.*test_volumes_backup_rbac.VolumesBackupsV318RbacTest)\
430 (?!.*test_volumes_backup_rbac.VolumesBackupsV39RbacTest)\
431 (?!.*test_volume_types_rbac)\
432 (?=.*[.*\bslow\b.*])\
433 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
438 case_name: patrole_member
439 project_name: functest
443 Test suite from Patrole project.
448 mode: "(?!.*test_unmanage_snapshot_rbac)\
449 (?!.*test_show_auto_allocated_topology)\
450 (?!.*test_delete_auto_allocated_topology)\
451 (?!.*test_create_network_provider_segmentation_id)\
452 (?!.*compute.test_floating_ips_rbac)\
453 (?!.*test_reset_network)\
454 (?!.*test_create_image_from_volume_backed_server)\
455 (?!.*test_network_ip_availability_rbac.NetworkIpAvailabilityExtRbacTest.test_get_network_ip_availabilities)\
456 (?!.*test_policy_bandwidth_limit_rule_rbac)\
457 (?!.*test_policy_minimum_bandwidth_rule_rbac)\
458 (?!.*test_group_type_specs)\
459 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_create_group_type)\
460 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_delete_group_type)\
461 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_update_group_type)\
462 (?!.*test_group_snapshots_rbac)\
463 (?!.*test_groups_rbac)\
464 (?!.*test_quota_classes_rbac)\
465 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_create_interface)\
466 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_delete_interface)\
467 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_show_interface)\
468 (?!.*test_user_messages_rbac)\
469 (?!.*test_volume_actions_rbac.VolumesActionsV310RbacTest)\
470 (?!.*test_volume_actions_rbac.VolumesActionsV312RbacTest)\
471 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_delete_volume_image_metadata)\
472 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_list_volumes_details_image_metadata)\
473 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_show_volume_details_image_metadata)\
474 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_update_volume_image_metadata)\
475 (?!.*test_volumes_backup_rbac.VolumesBackupsV318RbacTest)\
476 (?!.*test_volumes_backup_rbac.VolumesBackupsV39RbacTest)\
477 (?!.*test_volume_types_rbac)\
478 (?=.*[.*\bslow\b.*])\
479 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
484 case_name: patrole_reader
485 project_name: functest
489 Test suite from Patrole project.
494 mode: "(?!.*test_unmanage_snapshot_rbac)\
495 (?!.*test_show_auto_allocated_topology)\
496 (?!.*test_delete_auto_allocated_topology)\
497 (?!.*test_create_network_provider_segmentation_id)\
498 (?!.*compute.test_floating_ips_rbac)\
499 (?!.*test_reset_network)\
500 (?!.*test_create_image_from_volume_backed_server)\
501 (?!.*test_network_ip_availability_rbac.NetworkIpAvailabilityExtRbacTest.test_get_network_ip_availabilities)\
502 (?!.*test_policy_bandwidth_limit_rule_rbac)\
503 (?!.*test_policy_minimum_bandwidth_rule_rbac)\
504 (?!.*test_group_type_specs)\
505 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_create_group_type)\
506 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_delete_group_type)\
507 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_update_group_type)\
508 (?!.*test_group_snapshots_rbac)\
509 (?!.*test_groups_rbac)\
510 (?!.*test_quota_classes_rbac)\
511 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_create_interface)\
512 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_delete_interface)\
513 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_show_interface)\
514 (?!.*test_user_messages_rbac)\
515 (?!.*test_volume_actions_rbac.VolumesActionsV310RbacTest)\
516 (?!.*test_volume_actions_rbac.VolumesActionsV312RbacTest)\
517 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_delete_volume_image_metadata)\
518 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_list_volumes_details_image_metadata)\
519 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_show_volume_details_image_metadata)\
520 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_update_volume_image_metadata)\
521 (?!.*test_volumes_backup_rbac.VolumesBackupsV318RbacTest)\
522 (?!.*test_volumes_backup_rbac.VolumesBackupsV39RbacTest)\
523 (?!.*test_volume_types_rbac)\
524 (?=.*[.*\bslow\b.*])\
525 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
530 case_name: tempest_barbican
531 project_name: functest
535 It leverages on the tempest plugin containing tests used to
536 verify the functionality of a barbican installation.
541 '^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$'
548 case_name: tempest_octavia
549 project_name: functest
553 It leverages on the tempest plugin containing tests used to
554 verify the functionality of an octavia installation.
558 mode: "(?!.*api.v2.test_availability_zone)\
559 (?!.*api.v2.test_availability_zone_profile)\
560 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv4_create)\
561 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv6_create)\
562 (^octavia_tempest_plugin.tests.(api|scenario))"
569 case_name: tempest_cyborg
570 project_name: functest
574 It leverages on the tempest plugin containing tests used to
575 verify the functionality of a cyborg installation.
579 mode: '^cyborg_tempest_plugin'
588 Set of basic Functional tests to validate the OPNFV scenarios.
591 case_name: tempest_neutron_cntt
592 project_name: functest
598 This test case runs the Tempest suite proposed by the
599 Neutron project. The list of test cases is generated by
600 Tempest automatically and depends on the parameters of
601 the OpenStack deployment.
605 mode: "(?!.*admin.test_agent_availability_zone)\
606 (?!.*admin.test_dhcp_agent_scheduler)\
607 (?!.*admin.test_l3_agent_scheduler)\
608 (?!.*admin.test_logging)\
609 (?!.*admin.test_logging_negative)\
610 (?!.*admin.test_network_segment_range)\
611 (?!.*admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address)\
612 (?!.*admin.test_ports.PortTestCasesResourceRequest)\
613 (?!.*admin.test_routers_dvr)\
614 (?!.*admin.test_routers_flavors)\
615 (?!.*admin.test_routers_ha)\
616 (?!.*test_conntrack_helper)\
617 (?!.*test_floating_ips.FloatingIPPoolTestJSON)\
618 (?!.*test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details)\
620 (?!.*test_metering_extensions)\
621 (?!.*test_metering_negative)\
622 (?!.*test_networks.NetworksSearchCriteriaTest.test_list_validation_filters)\
623 (?!.*test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan)\
624 (?!.*test_networks.NetworksTestJSON.test_create_update_network_dns_domain)\
625 (?!.*test_port_forwardings)\
626 (?!.*test_ports.PortsTaggingOnCreation)\
627 (?!.*test_ports.PortsTestJSON.test_create_port_with_propagate_uplink_status)\
628 (?!.*test_ports.PortsTestJSON.test_create_port_without_propagate_uplink_status)\
629 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_domain)\
630 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_name)\
631 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name)\
632 (?!.*test_qos.QosMinimumBandwidthRuleTestJSON)\
633 (?!.*test_revisions.TestRevisions.test_update_dns_domain_bumps_revision)\
634 (?!.*test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision)\
635 (?!.*test_router_interface_fip)\
636 (?!.*test_routers.DvrRoutersTest)\
637 (?!.*test_routers.HaRoutersTest)\
638 (?!.*test_routers.RoutersIpV6Test.test_extra_routes_atomic)\
639 (?!.*test_routers.RoutersTest.test_extra_routes_atomic)\
640 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
641 (?!.*test_routers_negative.DvrRoutersNegativeTestExtended)\
642 (?!.*test_routers_negative.HaRoutersNegativeTest)\
643 (?!.*test_security_groups.RbacSharedSecurityGroupTest)\
644 (?!.*test_subnetpool_prefix_ops)\
645 (?!.*test_subnetpools.RbacSubnetPoolTest)\
646 (?!.*test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters)\
647 (?!.*test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_subnetpool_associate_shared_address_scope)\
648 (?!.*test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters)\
649 (?!.*test_timestamp.TestTimeStamp.test_segment_with_timestamp)\
650 (?!.*test_trunk.TrunkTestInheritJSONBase.test_add_subport)\
651 (?!.*test_trunk.TrunkTestMtusJSON)\
652 (?!.*test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type)\
653 (?!.*test_trunk_negative.TrunkTestMtusJSON)\
654 (^neutron_tempest_plugin.api)"
659 case_name: tempest_cinder_cntt
660 project_name: functest
666 This test case runs the Tempest suite proposed by the
671 mode: "(?!.*test_incremental_backup)\
672 (?!.*test_consistencygroups)\
673 (?!.*test_backup_crossproject_admin_negative)\
674 (?!.*test_backup_crossproject_user_negative)\
675 (?!.*test_volume_encrypted.TestEncryptedCinderVolumes)\
677 (^cinder_tempest_plugin.)"
682 case_name: tempest_keystone_cntt
683 project_name: functest
689 This test case runs the Tempest suite proposed by the
694 mode: "(?!.*api.identity.v3.test_oauth1_tokens)\
696 (?!.*scenario.test_federated_authentication)\
697 keystone_tempest_plugin."
702 case_name: tempest_heat_cntt
703 project_name: functest
709 This test case runs the Tempest suite proposed by the
714 mode: "(?!.*functional.test_lbaasv2)\
715 (?!.*functional.test_encryption_vol_type)\
716 (?!.*functional.test_event_sinks)\
717 (?!.*functional.test_software_config.ZaqarSignalTransportTest)\
718 (?!.*functional.test_stack_events)\
719 (?!.*functional.test_waitcondition)\
720 (?!.*RemoteStackTest.test_stack_create_with_cloud_credential)\
721 (?!.*scenario.test_aodh_alarm)\
722 (?!.*tests.scenario.test_autoscaling_lb)\
723 (?!.*scenario.test_autoscaling_lbv2)\
724 (?!.*scenario.test_server_software_config)\
725 (?!.*test_volumes.VolumeBackupRestoreIntegrationTest)\
726 (?!.*scenario.test_octavia_lbaas)\
727 (?!.*scenario.test_server_cfn_init)\
728 ^heat_tempest_plugin.tests"
733 case_name: rally_sanity_cntt
734 project_name: functest
738 This test case runs a sub group of tests of the OpenStack
739 Rally suite in smoke mode.
755 case_name: tempest_full_cntt
756 project_name: functest
762 The list of test cases is generated by
763 Tempest automatically and depends on the parameters of
764 the OpenStack deployment.
765 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
769 mode: "(?!.*admin.test_agents)(?!.*test_fixed_ips)\
770 (?!.*test_fixed_ips_negative)\
771 (?!.*test_auto_allocate_network)(?!.*test_floating_ips_bulk)\
772 (?!.*test_flavors_microversions.FlavorsV255TestJSON)\
773 (?!.*test_flavors_microversions.FlavorsV261TestJSON)\
774 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_iscsi_volume)\
775 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration)\
776 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration_paused)\
777 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_volume_backed_live_migration)\
778 (?!.*test_live_migration.LiveMigrationTest.test_iscsi_volume)\
779 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration)\
780 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration_paused)\
781 (?!.*test_live_migration.LiveMigrationTest.test_volume_backed_live_migration)\
782 (?!.*test_live_migration.LiveMigrationRemoteConsolesV26Test)\
783 (?!.*test_quotas.QuotasAdminTestV257)\
784 (?!.*test_servers.ServersAdminTestJSON.test_reset_network_inject_network_info)\
785 (?!.*certificates.test_certificates)\
786 (?!.*test_quotas_negative.QuotasSecurityGroupAdminNegativeTest)\
787 (?!.*test_novnc)(?!.*test_server_personality)\
788 (?!.*test_servers.ServerShowV263Test.test_show_update_rebuild_list_server)\
789 (?!.*test_servers_microversions.ServerShowV254Test)\
790 (?!.*test_servers_microversions.ServerShowV257Test)\
791 (?!.*test_servers_negative.ServersNegativeTestJSON.test_personality_file_contents_not_encoded)\
792 (?!.*servers.test_virtual_interfaces)\
793 (?!.*test_server_actions.ServerActionsTestJSON.test_change_server_password)\
794 (?!.*test_server_actions.ServerActionsTestJSON.test_get_vnc_console)\
795 (?!.*test_server_actions.ServerActionsTestJSON.test_reboot_server_soft)\
796 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
797 (?!.*test_server_rescue.ServerStableDeviceRescueTest)\
798 (?!.*test_security_group_default_rules)\
799 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_duplicate_name)\
800 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_description)\
801 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_name)\
802 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_des)\
803 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_id)\
804 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_name)\
805 (?!.*test_create_server.ServersTestFqdnHostnames.test_create_server_with_fqdn_name)\
806 (?!.*test_server_metadata.ServerMetadataTestJSON)\
807 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_delete_metadata_non_existent_server)\
808 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_metadata_items_limit)\
809 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_metadata_invalid_key)\
810 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_metadata_non_existent_server)\
811 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_server_metadata_blank_key)\
812 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_server_metadata_missing_metadata)\
813 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_update_metadata_non_existent_server)\
814 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_update_metadata_with_blank_key)\
815 (?!.*test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex)\
816 (?!.*compute.test_virtual_interfaces)(?!.*compute.test_virtual_interfaces_negative)\
817 (?!.*compute.test_networks)\
818 (?!.*test_attach_volume.AttachVolumeMultiAttach)\
819 (?!.*identity.admin.v2)(?!.*identity.v2)\
820 (?!.*identity.v3.test_access_rules)\
821 (?!.*identity.v3.test_application_credentials.ApplicationCredentialsV3Test.test_create_application_credential_access_rules)\
823 (?!.*image.v2.admin.test_images.ImportCopyImagesTest)\
824 (?!.*image.v2.test_images_negative.ImagesNegativeTest.test_create_image_reserved_property)\
825 (?!.*image.v2.test_images_negative.ImagesNegativeTest.test_update_image_reserved_property)\
826 (?!.*image.v2.test_images_negative.ImportImagesNegativeTest.test_image_web_download_import_with_bad_url)\
827 (?!.*image.v2.test_images.ImportImagesTest)\
828 (?!.*image.v2.test_images.MultiStoresImportImages)\
829 (?!.*admin.test_dhcp_agent_scheduler)\
830 (?!.*admin.test_routers_dvr)\
831 (?!.*test_metering_extensions)(?!.*network.test_tags)\
832 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
833 (?!.*test_routers.RoutersIpV6Test.test_create_router_set_gateway_with_fixed_ip)\
834 (?!.*test_routers.RoutersTest.test_create_router_set_gateway_with_fixed_ip)\
835 (?!.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding)\
836 (?!.*test_encrypted_volumes_extend)\
837 (?!.*test_group_snapshots.GroupSnapshotsV319Test.test_reset_group_snapshot_status)\
838 (?!.*test_multi_backend)\
839 (?!.*test_volume_retype.VolumeRetypeWithMigrationTest)\
840 (?!.*test_volume_delete_cascade.VolumesDeleteCascade.test_volume_from_snapshot_cascade_delete)\
841 (?!.*test_volumes_backup.VolumesBackupsTest.test_volume_backup_create_get_detailed_list_restore_delete)\
842 (?!.*test_volumes_negative.UpdateMultiattachVolumeNegativeTest.test_multiattach_rw_volume_update_failure)\
843 (?!.*test_volumes_extend.VolumesExtendAttachedTest.test_extend_attached_volume)\
844 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.api)"
849 case_name: tempest_scenario_cntt
850 project_name: functest
856 The list of test cases is generated by
857 Tempest automatically and depends on the parameters of
858 the OpenStack deployment.
859 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
861 name: tempest_scenario
864 (?!.*test_compute_unified_limits)\
865 (?!.*test_minbw_allocation_placement)\
866 (?!.*test_network_qos_placement)\
867 (?!.*test_unified_limits.ImageQuotaTest.test_image_count_uploading_quota)\
868 (?!.*test_unified_limits.ImageQuotaTest.test_image_stage_quota)\
869 (?!.*test_volume_boot_pattern.TestVolumeBootPattern.test_boot_server_from_encrypted_volume_luks)\
870 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.scenario)"
875 case_name: tempest_slow_cntt
876 project_name: functest
882 The list of test cases is generated by
883 Tempest automatically and depends on the parameters of
884 the OpenStack deployment.
885 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
889 mode: "(?!.*test_volume_swap)\
890 (?!.*test_server_personality)\
891 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
892 (?!.*test_container_sync.ContainerSyncTest.test_container_synchronization)\
893 (?!.*test_container_sync_middleware.ContainerSyncMiddlewareTest.test_container_synchronization)\
894 (?!.*test_encrypted_cinder_volumes)\
895 (?!.*test_minbw_allocation_placement)\
896 (?!.*test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling)\
897 (?!.*test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance)\
898 (?!.*test_volume_migrate_attached)\
899 (?!.*test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration_revert)\
900 (?=.*\\[.*\\bslow\\b.*\\])(^tempest.)"
907 Run several OpenStack performance tools
908 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
911 case_name: rally_full
912 project_name: functest
916 This test case runs the full suite of scenarios of the
917 OpenStack Rally suite using several threads and iterations.
926 case_name: rally_jobs
927 project_name: functest
931 This test case runs a group of Rally jobs used in
934 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
943 project_name: functest
947 VMTP is a small python application that will automatically
948 perform ping connectivity, round trip time measurement
949 (latency) and TCP/UDP throughput
951 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
957 project_name: functest
961 Shaker wraps around popular system network testing tools
962 like iperf, iperf3 and netperf (with help of flent). Shaker
963 is able to deploy OpenStack instances and networks in
964 different topologies.
966 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
971 name: benchmarking_cntt
973 Run several OpenStack performance tools
974 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
977 case_name: rally_full_cntt
978 project_name: functest
982 This test case runs the full suite of scenarios of the
983 OpenStack Rally suite using several threads and iterations.
999 case_name: rally_jobs_cntt
1000 project_name: functest
1004 This test case runs a group of Rally jobs used in
1015 Collection of VNF test cases.
1019 project_name: functest
1023 This test case deploys the Cloudify orchestrator.
1027 case_name: cloudify_ims
1028 project_name: functest
1032 This test case deploys an OpenSource vIMS solution from
1033 Clearwater using the Cloudify orchestrator. It also runs
1034 some signaling traffic.
1036 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
1042 project_name: functest
1046 This test case deploys an OpenSource vIMS solution from
1047 Clearwater using the OpenStack Heat orchestrator.
1048 It also runs some signaling traffic.
1050 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
1055 case_name: vyos_vrouter
1056 project_name: functest
1060 This test case is vRouter testing.
1062 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
1068 project_name: functest
1072 vEPC validation with Juju as VNF manager and ABoT as test
1075 - NO_TENANT_NETWORK: '^(?![tT]rue$)'