6 First tier to be executed to verify the basic
10 case_name: connection_check
11 project_name: functest
15 This test case verifies the retrieval of OpenStack clients:
16 Keystone, Glance, Neutron and Nova and may perform some
19 name: connection_check
22 case_name: tenantnetwork1
23 project_name: functest
27 It creates and configures all tenant network ressources
28 required by advanced testcases (subnet, network and
31 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
36 case_name: tenantnetwork2
37 project_name: functest
41 It creates new user/project before creating and configuring
42 all tenant network ressources required by a testcase
43 (subnet, network and router).
45 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
51 project_name: functest
55 It inherits from TenantNetwork1 which creates all network
56 resources and prepares a future VM attached to that
63 project_name: functest
67 It creates new user/project before creating and configuring
68 all tenant network ressources, flavors, images, etc.
69 required by advanced testcases.
75 project_name: functest
79 It inherits from TenantNetwork1 which creates all network
80 resources and completes it by booting a VM attached to that
87 project_name: functest
91 It creates new user/project before creating and configuring
92 all tenant network ressources and vms required by advanced
99 project_name: functest
103 This test case verifies: 1) SSH to an instance using
104 floating IPs over the public network. 2) Connectivity
105 between 2 instances over a private network.
110 case_name: vping_userdata
111 project_name: functest
115 This test case verifies: 1) Boot a VM with given userdata.
116 2) Connectivity between 2 instances over a private network.
121 case_name: cinder_test
122 project_name: functest
126 This test case verifies: 1) Attach volume and to 1
127 instance; 2) Write data on volume 3) Detach volume
128 from instance 1, attach it on instance 2 3) Read volume
135 project_name: functest
139 Test Suite for the OpenDaylight SDN Controller. It
140 integrates some test suites from upstream using
141 Robot as the test framework.
143 - DEPLOY_SCENARIO: 'odl'
148 - /src/odl_test/csit/suites/integration/basic
149 - /src/odl_test/csit/suites/openstack/neutron
152 case_name: tempest_smoke
153 project_name: functest
157 This test case runs the smoke subset of the OpenStack
158 Tempest suite. The list of test cases is generated by
159 Tempest automatically and depends on the parameters of
160 the OpenStack deplopyment.
161 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L114
165 mode: '(?=.*\[.*\bsmoke\b.*\])(^tempest\.api)'
170 case_name: tempest_horizon
171 project_name: functest
175 This test case runs the Tempest suite proposed by the
178 - DASHBOARD_URL: '^(?!\s*$).+'
182 mode: '^tempest.scenario.test_dashboard_basic_ops.'
187 Set of basic Functional tests to validate the OPNFV scenarios.
190 case_name: tempest_neutron
191 project_name: functest
195 This test case runs the Tempest suite proposed by the
196 Neutron project. The list of test cases is generated by
197 Tempest automatically and depends on the parameters of
198 the OpenStack deployment.
202 mode: '^neutron_tempest_plugin\.api'
207 case_name: tempest_cinder
208 project_name: functest
212 This test case runs the Tempest suite proposed by the
217 mode: "(?!.*test_incremental_backup)\
218 (?!.*test_backup_crossproject_admin_negative)\
219 (?!.*test_backup_crossproject_user_negative)\
220 (^cinder_tempest_plugin.)"
225 case_name: tempest_keystone
226 project_name: functest
230 This test case runs the Tempest suite proposed by the
235 mode: 'keystone_tempest_plugin.'
240 case_name: tempest_heat
241 project_name: functest
245 This test case runs the Tempest suite proposed by the
250 mode: '^heat_tempest_plugin.tests'
255 case_name: tempest_telemetry
256 project_name: functest
260 This test case runs the Tempest suite proposed by the
265 mode: "(?!.*test_autoscaling)(?!.*test_live)\
266 (^telemetry_tempest_plugin)"
275 case_name: rally_sanity
276 project_name: functest
280 This test case runs a sub group of tests of the OpenStack
281 Rally suite in smoke mode.
290 case_name: refstack_compute
291 project_name: functest
295 This test case runs a sub group of tests of the OpenStack
298 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
307 case_name: refstack_object
308 project_name: functest
312 This test case runs a sub group of tests of the OpenStack
322 case_name: refstack_platform
323 project_name: functest
327 This test case runs a sub group of tests of the OpenStack
330 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
339 case_name: tempest_full
340 project_name: functest
344 The list of test cases is generated by
345 Tempest automatically and depends on the parameters of
346 the OpenStack deployment.
347 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
351 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.api)'
356 case_name: tempest_scenario
357 project_name: functest
361 The list of test cases is generated by
362 Tempest automatically and depends on the parameters of
363 the OpenStack deployment.
364 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
368 mode: '(?!.*\[.*\bslow\b.*\])(^tempest\.scenario)'
373 case_name: tempest_slow
374 project_name: functest
378 The list of test cases is generated by
379 Tempest automatically and depends on the parameters of
380 the OpenStack deployment.
381 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
385 mode: '(?=.*\[.*\bslow\b.*\])(^tempest\.)'
390 case_name: patrole_admin
391 project_name: functest
395 Test suite from Patrole project.
400 mode: "(?!.*test_unmanage_snapshot_rbac)\
401 (?!.*test_show_auto_allocated_topology)\
402 (?!.*test_delete_auto_allocated_topology)\
403 (?!.*test_create_network_provider_segmentation_id)\
404 (?!.*compute.test_floating_ips_rbac)\
405 (?!.*test_reset_network)\
406 (?!.*test_create_image_from_volume_backed_server)\
407 (?!.*test_network_ip_availability_rbac.NetworkIpAvailabilityExtRbacTest.test_get_network_ip_availabilities)\
408 (?!.*test_policy_bandwidth_limit_rule_rbac)\
409 (?!.*test_policy_minimum_bandwidth_rule_rbac)\
410 (?!.*test_group_type_specs)\
411 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_create_group_type)\
412 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_delete_group_type)\
413 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_update_group_type)\
414 (?!.*test_group_snapshots_rbac)\
415 (?!.*test_groups_rbac)\
416 (?!.*test_quota_classes_rbac)\
417 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_create_interface)\
418 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_delete_interface)\
419 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_show_interface)\
420 (?!.*test_user_messages_rbac)\
421 (?!.*test_volume_actions_rbac.VolumesActionsV310RbacTest)\
422 (?!.*test_volume_actions_rbac.VolumesActionsV312RbacTest)\
423 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_delete_volume_image_metadata)\
424 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_list_volumes_details_image_metadata)\
425 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_show_volume_details_image_metadata)\
426 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_update_volume_image_metadata)\
427 (?!.*test_volumes_backup_rbac.VolumesBackupsV318RbacTest)\
428 (?!.*test_volumes_backup_rbac.VolumesBackupsV39RbacTest)\
429 (?!.*test_volume_types_rbac)\
430 (?=.*[.*\bslow\b.*])\
431 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
436 case_name: patrole_member
437 project_name: functest
441 Test suite from Patrole project.
446 mode: "(?!.*test_unmanage_snapshot_rbac)\
447 (?!.*test_show_auto_allocated_topology)\
448 (?!.*test_delete_auto_allocated_topology)\
449 (?!.*test_create_network_provider_segmentation_id)\
450 (?!.*compute.test_floating_ips_rbac)\
451 (?!.*test_reset_network)\
452 (?!.*test_create_image_from_volume_backed_server)\
453 (?!.*test_network_ip_availability_rbac.NetworkIpAvailabilityExtRbacTest.test_get_network_ip_availabilities)\
454 (?!.*test_policy_bandwidth_limit_rule_rbac)\
455 (?!.*test_policy_minimum_bandwidth_rule_rbac)\
456 (?!.*test_group_type_specs)\
457 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_create_group_type)\
458 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_delete_group_type)\
459 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_update_group_type)\
460 (?!.*test_group_snapshots_rbac)\
461 (?!.*test_groups_rbac)\
462 (?!.*test_quota_classes_rbac)\
463 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_create_interface)\
464 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_delete_interface)\
465 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_show_interface)\
466 (?!.*test_user_messages_rbac)\
467 (?!.*test_volume_actions_rbac.VolumesActionsV310RbacTest)\
468 (?!.*test_volume_actions_rbac.VolumesActionsV312RbacTest)\
469 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_delete_volume_image_metadata)\
470 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_list_volumes_details_image_metadata)\
471 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_show_volume_details_image_metadata)\
472 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_update_volume_image_metadata)\
473 (?!.*test_volumes_backup_rbac.VolumesBackupsV318RbacTest)\
474 (?!.*test_volumes_backup_rbac.VolumesBackupsV39RbacTest)\
475 (?!.*test_volume_types_rbac)\
476 (?=.*[.*\bslow\b.*])\
477 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
482 case_name: patrole_reader
483 project_name: functest
487 Test suite from Patrole project.
492 mode: "(?!.*test_unmanage_snapshot_rbac)\
493 (?!.*test_show_auto_allocated_topology)\
494 (?!.*test_delete_auto_allocated_topology)\
495 (?!.*test_create_network_provider_segmentation_id)\
496 (?!.*compute.test_floating_ips_rbac)\
497 (?!.*test_reset_network)\
498 (?!.*test_create_image_from_volume_backed_server)\
499 (?!.*test_network_ip_availability_rbac.NetworkIpAvailabilityExtRbacTest.test_get_network_ip_availabilities)\
500 (?!.*test_policy_bandwidth_limit_rule_rbac)\
501 (?!.*test_policy_minimum_bandwidth_rule_rbac)\
502 (?!.*test_group_type_specs)\
503 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_create_group_type)\
504 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_delete_group_type)\
505 (?!.*test_groups_rbac.GroupTypesV3RbacTest.test_update_group_type)\
506 (?!.*test_group_snapshots_rbac)\
507 (?!.*test_groups_rbac)\
508 (?!.*test_quota_classes_rbac)\
509 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_create_interface)\
510 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_delete_interface)\
511 (?!.*test_server_misc_policy_actions_rbac.MiscPolicyActionsNetworkRbacTest.test_show_interface)\
512 (?!.*test_user_messages_rbac)\
513 (?!.*test_volume_actions_rbac.VolumesActionsV310RbacTest)\
514 (?!.*test_volume_actions_rbac.VolumesActionsV312RbacTest)\
515 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_delete_volume_image_metadata)\
516 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_list_volumes_details_image_metadata)\
517 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_show_volume_details_image_metadata)\
518 (?!.*test_volume_metadata_rbac.VolumeMetadataV3RbacTest.test_update_volume_image_metadata)\
519 (?!.*test_volumes_backup_rbac.VolumesBackupsV318RbacTest)\
520 (?!.*test_volumes_backup_rbac.VolumesBackupsV39RbacTest)\
521 (?!.*test_volume_types_rbac)\
522 (?=.*[.*\bslow\b.*])\
523 (^patrole_tempest_plugin.tests.api.(compute|image|network|volume))"
528 case_name: tempest_barbican
529 project_name: functest
533 It leverages on the tempest plugin containing tests used to
534 verify the functionality of a barbican installation.
539 '^barbican_tempest_plugin.((?!test_signed_image_upload_boot_failure).)*$'
546 case_name: tempest_octavia
547 project_name: functest
551 It leverages on the tempest plugin containing tests used to
552 verify the functionality of an octavia installation.
556 mode: "(?!.*api.v2.test_availability_zone)\
557 (?!.*api.v2.test_availability_zone_profile)\
558 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv4_create)\
559 (?!.*api.v2.test_member.MemberAPITest.test_member_ipv6_create)\
560 (^octavia_tempest_plugin.tests.(api|scenario))"
567 case_name: tempest_cyborg
568 project_name: functest
572 It leverages on the tempest plugin containing tests used to
573 verify the functionality of a cyborg installation.
577 mode: '^cyborg_tempest_plugin'
586 Set of basic Functional tests to validate the OPNFV scenarios.
589 case_name: tempest_neutron_cntt
590 project_name: functest
596 This test case runs the Tempest suite proposed by the
597 Neutron project. The list of test cases is generated by
598 Tempest automatically and depends on the parameters of
599 the OpenStack deployment.
603 mode: "(?!.*admin.test_agent_availability_zone)\
604 (?!.*admin.test_dhcp_agent_scheduler)\
605 (?!.*admin.test_l3_agent_scheduler)\
606 (?!.*admin.test_logging)\
607 (?!.*admin.test_logging_negative)\
608 (?!.*admin.test_network_segment_range)\
609 (?!.*admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address)\
610 (?!.*admin.test_ports.PortTestCasesResourceRequest)\
611 (?!.*admin.test_routers_dvr)\
612 (?!.*admin.test_routers_flavors)\
613 (?!.*admin.test_routers_ha)\
614 (?!.*test_conntrack_helper)\
615 (?!.*test_floating_ips.FloatingIPPoolTestJSON)\
616 (?!.*test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details)\
618 (?!.*test_metering_extensions)\
619 (?!.*test_metering_negative)\
620 (?!.*test_networks.NetworksSearchCriteriaTest.test_list_validation_filters)\
621 (?!.*test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan)\
622 (?!.*test_networks.NetworksTestJSON.test_create_update_network_dns_domain)\
623 (?!.*test_port_forwardings)\
624 (?!.*test_ports.PortsTaggingOnCreation)\
625 (?!.*test_ports.PortsTestJSON.test_create_port_with_propagate_uplink_status)\
626 (?!.*test_ports.PortsTestJSON.test_create_port_without_propagate_uplink_status)\
627 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_domain)\
628 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_name)\
629 (?!.*test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name)\
630 (?!.*test_qos.QosMinimumBandwidthRuleTestJSON)\
631 (?!.*test_revisions.TestRevisions.test_update_dns_domain_bumps_revision)\
632 (?!.*test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision)\
633 (?!.*test_router_interface_fip)\
634 (?!.*test_routers.DvrRoutersTest)\
635 (?!.*test_routers.HaRoutersTest)\
636 (?!.*test_routers.RoutersIpV6Test.test_extra_routes_atomic)\
637 (?!.*test_routers.RoutersTest.test_extra_routes_atomic)\
638 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
639 (?!.*test_routers_negative.DvrRoutersNegativeTestExtended)\
640 (?!.*test_routers_negative.HaRoutersNegativeTest)\
641 (?!.*test_security_groups.RbacSharedSecurityGroupTest)\
642 (?!.*test_subnetpool_prefix_ops)\
643 (?!.*test_subnetpools.RbacSubnetPoolTest)\
644 (?!.*test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters)\
645 (?!.*test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_subnetpool_associate_shared_address_scope)\
646 (?!.*test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters)\
647 (?!.*test_timestamp.TestTimeStamp.test_segment_with_timestamp)\
648 (?!.*test_trunk.TrunkTestInheritJSONBase.test_add_subport)\
649 (?!.*test_trunk.TrunkTestMtusJSON)\
650 (?!.*test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type)\
651 (?!.*test_trunk_negative.TrunkTestMtusJSON)\
652 (^neutron_tempest_plugin.api)"
657 case_name: tempest_cinder_cntt
658 project_name: functest
664 This test case runs the Tempest suite proposed by the
669 mode: "(?!.*test_incremental_backup)\
670 (?!.*test_consistencygroups)\
671 (?!.*test_backup_crossproject_admin_negative)\
672 (?!.*test_backup_crossproject_user_negative)\
673 (?!.*test_volume_encrypted.TestEncryptedCinderVolumes)\
675 (^cinder_tempest_plugin.)"
680 case_name: tempest_keystone_cntt
681 project_name: functest
687 This test case runs the Tempest suite proposed by the
692 mode: "(?!.*api.identity.v3.test_oauth1_tokens)\
694 (?!.*scenario.test_federated_authentication)\
695 keystone_tempest_plugin."
700 case_name: tempest_heat_cntt
701 project_name: functest
707 This test case runs the Tempest suite proposed by the
712 mode: "(?!.*functional.test_lbaasv2)\
713 (?!.*functional.test_encryption_vol_type)\
714 (?!.*functional.test_event_sinks)\
715 (?!.*functional.test_software_config.ZaqarSignalTransportTest)\
716 (?!.*functional.test_stack_events)\
717 (?!.*functional.test_waitcondition)\
718 (?!.*RemoteStackTest.test_stack_create_with_cloud_credential)\
719 (?!.*scenario.test_aodh_alarm)\
720 (?!.*tests.scenario.test_autoscaling_lb)\
721 (?!.*scenario.test_autoscaling_lbv2)\
722 (?!.*scenario.test_server_software_config)\
723 (?!.*test_volumes.VolumeBackupRestoreIntegrationTest)\
724 (?!.*scenario.test_octavia_lbaas)\
725 (?!.*scenario.test_server_cfn_init)\
726 ^heat_tempest_plugin.tests"
731 case_name: rally_sanity_cntt
732 project_name: functest
736 This test case runs a sub group of tests of the OpenStack
737 Rally suite in smoke mode.
753 case_name: tempest_full_cntt
754 project_name: functest
760 The list of test cases is generated by
761 Tempest automatically and depends on the parameters of
762 the OpenStack deployment.
763 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83
767 mode: "(?!.*admin.test_agents)(?!.*test_fixed_ips)\
768 (?!.*test_fixed_ips_negative)\
769 (?!.*test_auto_allocate_network)(?!.*test_floating_ips_bulk)\
770 (?!.*test_flavors_microversions.FlavorsV255TestJSON)\
771 (?!.*test_flavors_microversions.FlavorsV261TestJSON)\
772 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_iscsi_volume)\
773 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration)\
774 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration_paused)\
775 (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_volume_backed_live_migration)\
776 (?!.*test_live_migration.LiveMigrationTest.test_iscsi_volume)\
777 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration)\
778 (?!.*test_live_migration.LiveMigrationTest.test_live_block_migration_paused)\
779 (?!.*test_live_migration.LiveMigrationTest.test_volume_backed_live_migration)\
780 (?!.*test_live_migration.LiveMigrationRemoteConsolesV26Test)\
781 (?!.*test_quotas.QuotasAdminTestV257)\
782 (?!.*test_servers.ServersAdminTestJSON.test_reset_network_inject_network_info)\
783 (?!.*certificates.test_certificates)\
784 (?!.*test_quotas_negative.QuotasSecurityGroupAdminNegativeTest)\
785 (?!.*test_novnc)(?!.*test_server_personality)\
786 (?!.*test_servers.ServerShowV263Test.test_show_update_rebuild_list_server)\
787 (?!.*test_servers_microversions.ServerShowV254Test)\
788 (?!.*test_servers_microversions.ServerShowV257Test)\
789 (?!.*test_servers_negative.ServersNegativeTestJSON.test_personality_file_contents_not_encoded)\
790 (?!.*servers.test_virtual_interfaces)\
791 (?!.*test_server_actions.ServerActionsTestJSON.test_change_server_password)\
792 (?!.*test_server_actions.ServerActionsTestJSON.test_get_vnc_console)\
793 (?!.*test_server_actions.ServerActionsTestJSON.test_reboot_server_soft)\
794 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
795 (?!.*test_server_rescue.ServerStableDeviceRescueTest)\
796 (?!.*test_security_group_default_rules)\
797 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_duplicate_name)\
798 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_description)\
799 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_name)\
800 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_des)\
801 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_id)\
802 (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_name)\
803 (?!.*test_create_server.ServersTestFqdnHostnames.test_create_server_with_fqdn_name)\
804 (?!.*test_server_metadata.ServerMetadataTestJSON)\
805 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_delete_metadata_non_existent_server)\
806 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_metadata_items_limit)\
807 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_metadata_invalid_key)\
808 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_metadata_non_existent_server)\
809 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_server_metadata_blank_key)\
810 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_server_metadata_missing_metadata)\
811 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_update_metadata_non_existent_server)\
812 (?!.*test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_update_metadata_with_blank_key)\
813 (?!.*test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex)\
814 (?!.*compute.test_virtual_interfaces)(?!.*compute.test_virtual_interfaces_negative)\
815 (?!.*compute.test_networks)\
816 (?!.*test_attach_volume.AttachVolumeMultiAttach)\
817 (?!.*identity.admin.v2)(?!.*identity.v2)\
818 (?!.*identity.v3.test_access_rules)\
819 (?!.*identity.v3.test_application_credentials.ApplicationCredentialsV3Test.test_create_application_credential_access_rules)\
821 (?!.*image.v2.admin.test_images.ImportCopyImagesTest)\
822 (?!.*image.v2.test_images_negative.ImagesNegativeTest.test_create_image_reserved_property)\
823 (?!.*image.v2.test_images_negative.ImagesNegativeTest.test_update_image_reserved_property)\
824 (?!.*image.v2.test_images_negative.ImportImagesNegativeTest.test_image_web_download_import_with_bad_url)\
825 (?!.*image.v2.test_images.ImportImagesTest)\
826 (?!.*image.v2.test_images.MultiStoresImportImages)\
827 (?!.*admin.test_dhcp_agent_scheduler)\
828 (?!.*admin.test_routers_dvr)\
829 (?!.*test_metering_extensions)(?!.*network.test_tags)\
830 (?!.*test_routers_negative.DvrRoutersNegativeTest)\
831 (?!.*test_routers.RoutersIpV6Test.test_create_router_set_gateway_with_fixed_ip)\
832 (?!.*test_routers.RoutersTest.test_create_router_set_gateway_with_fixed_ip)\
833 (?!.*test_object_services.ObjectTest.test_create_object_with_transfer_encoding)\
834 (?!.*test_encrypted_volumes_extend)\
835 (?!.*test_group_snapshots.GroupSnapshotsV319Test.test_reset_group_snapshot_status)\
836 (?!.*test_multi_backend)\
837 (?!.*test_volume_retype.VolumeRetypeWithMigrationTest)\
838 (?!.*test_volume_delete_cascade.VolumesDeleteCascade.test_volume_from_snapshot_cascade_delete)\
839 (?!.*test_volumes_backup.VolumesBackupsTest.test_volume_backup_create_get_detailed_list_restore_delete)\
840 (?!.*test_volumes_negative.UpdateMultiattachVolumeNegativeTest.test_multiattach_rw_volume_update_failure)\
841 (?!.*test_volumes_extend.VolumesExtendAttachedTest.test_extend_attached_volume)\
842 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.api)"
847 case_name: tempest_scenario_cntt
848 project_name: functest
854 The list of test cases is generated by
855 Tempest automatically and depends on the parameters of
856 the OpenStack deployment.
857 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
859 name: tempest_scenario
862 (?!.*test_compute_unified_limits)\
863 (?!.*test_minbw_allocation_placement)\
864 (?!.*test_network_qos_placement)\
865 (?!.*test_unified_limits.ImageQuotaTest.test_image_count_uploading_quota)\
866 (?!.*test_unified_limits.ImageQuotaTest.test_image_stage_quota)\
867 (?!.*test_volume_boot_pattern.TestVolumeBootPattern.test_boot_server_from_encrypted_volume_luks)\
868 (?!.*\\[.*\\bslow\\b.*\\])(^tempest.scenario)"
873 case_name: tempest_slow_cntt
874 project_name: functest
880 The list of test cases is generated by
881 Tempest automatically and depends on the parameters of
882 the OpenStack deployment.
883 https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84
887 mode: "(?!.*test_volume_swap)\
888 (?!.*test_server_personality)\
889 (?!.*test_server_rescue.ServerBootFromVolumeStableRescueTest)\
890 (?!.*test_container_sync.ContainerSyncTest.test_container_synchronization)\
891 (?!.*test_container_sync_middleware.ContainerSyncMiddlewareTest.test_container_synchronization)\
892 (?!.*test_encrypted_cinder_volumes)\
893 (?!.*test_minbw_allocation_placement)\
894 (?!.*test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling)\
895 (?!.*test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance)\
896 (?!.*test_volume_migrate_attached)\
897 (?!.*test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration_revert)\
898 (?=.*\\[.*\\bslow\\b.*\\])(^tempest.)"
905 Run several OpenStack performance tools
906 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
909 case_name: rally_full
910 project_name: functest
914 This test case runs the full suite of scenarios of the
915 OpenStack Rally suite using several threads and iterations.
924 case_name: rally_jobs
925 project_name: functest
929 This test case runs a group of Rally jobs used in
932 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
941 project_name: functest
945 VMTP is a small python application that will automatically
946 perform ping connectivity, round trip time measurement
947 (latency) and TCP/UDP throughput
949 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
955 project_name: functest
959 Shaker wraps around popular system network testing tools
960 like iperf, iperf3 and netperf (with help of flent). Shaker
961 is able to deploy OpenStack instances and networks in
962 different topologies.
964 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
969 name: benchmarking_cntt
971 Run several OpenStack performance tools
972 https://docs.openstack.org/performance-docs/latest/methodologies/tools.html
975 case_name: rally_full_cntt
976 project_name: functest
980 This test case runs the full suite of scenarios of the
981 OpenStack Rally suite using several threads and iterations.
997 case_name: rally_jobs_cntt
998 project_name: functest
1002 This test case runs a group of Rally jobs used in
1013 Collection of VNF test cases.
1017 project_name: functest
1021 This test case deploys the Cloudify orchestrator.
1025 case_name: cloudify_ims
1026 project_name: functest
1030 This test case deploys an OpenSource vIMS solution from
1031 Clearwater using the Cloudify orchestrator. It also runs
1032 some signaling traffic.
1034 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
1040 project_name: functest
1044 This test case deploys an OpenSource vIMS solution from
1045 Clearwater using the OpenStack Heat orchestrator.
1046 It also runs some signaling traffic.
1048 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
1053 case_name: vyos_vrouter
1054 project_name: functest
1058 This test case is vRouter testing.
1060 - NO_TENANT_NETWORK: '^(?![tT]rue$)'
1066 project_name: functest
1070 vEPC validation with Juju as VNF manager and ABoT as test
1073 - NO_TENANT_NETWORK: '^(?![tT]rue$)'