---
tiers:
  - name: smoke
    description: >-
      A set of conformance tests integrated from kubernetes project.
    testcases:
      - case_name: xrally_kubernetes
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          All in one tasks for checking basic functionality of
          Kubernetes cluster.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: xrally_kubernetes
      - case_name: k8s_conformance
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          Conformance Tests are expect to pass on any Kubernetes
          cluster, this tests are necessary demonstrate conformance
          of the Kubernetes deployment.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[Conformance\]
              skip: \[Serial\]|\[Disruptive\]|NoExecuteTaintManager
      - case_name: k8s_conformance_serial
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          Conformance Tests are expect to pass on any Kubernetes
          cluster, this tests are necessary demonstrate conformance
          of the Kubernetes deployment.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            ginkgo:
              focus: \[Serial\].*\[Conformance\]
              skip: \[Disruptive\]|NoExecuteTaintManager
      - case_name: sig_api_machinery
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-api-machinery testing excluding
          the label Conformance (part of k8s_conformance) and
          StorageVersionAPI.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-api-machinery\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[Feature:StorageVersionAPI\\]"
      - case_name: sig_apps
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-apps testing excluding the
          following labels: Conformance (part of k8s_conformance) and
          both StatefulUpgrade and StatefulSet features.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-apps]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[Feature:StatefulUpgrade\\]|\
                \\[Feature:StatefulSet\\]"
      - case_name: sig_auth
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-auth testing excluding the
          following labels: Conformance (part of k8s_conformance) and
          both PodSecurityPolicy and BoundServiceAccountTokenVolume
          features.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-auth\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[Feature:PodSecurityPolicy\\]|\
                \\[Feature:BoundServiceAccountTokenVolume\\]"
      - case_name: sig_cli
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-cli testing excluding Conformance
          (part of k8s_conformance).
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-cli]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]"
      - case_name: sig_cluster_lifecycle
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-cluster-lifecycle testing
          excluding Conformance (part of k8s_conformance).
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-cluster-lifecycle\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]"
      - case_name: sig_network
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-network testing excluding the
          following labels: Conformance (part of k8s_conformance),
          all features and load.balancer.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-network\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|load.balancer|\
                LoadBalancer|\\[Feature:.+\\]"
      - case_name: sig_network_features
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It verifies a couple of features by running a subset of e2e
          tests: Ingress, Networking-IPv4, Networking-Performance,
          PerformanceDNS and NoSNAT. It excludes by default
          NetworkPolicy, Networking-IPv6, IPv6DualStackAlphaFeature,
          SCTP and Example. A couple of features may be automatically
          skipped like NEG and kubemci.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: "\\[Feature:Ingress\\]|\
                \\[Feature:Networking-IPv4\\]|\
                \\[Feature:Networking-Performance\\]|\
                \\[Feature:PerformanceDNS\\]|\\[Feature:NoSNAT\\]"
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[Feature:NetworkPolicy\\]|\
                \\[Feature:Networking-IPv6\\]|\
                \\[Feature:IPv6DualStackAlphaFeature\\]|\
                \\[Feature:SCTP\\]|\\[Feature:Example\\]"
      - case_name: sig_node
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-node testing excluding the
          following labels: Conformance (part of k8s_conformance),
          RuntimeClass, all RuntimeHandler, PodGarbageCollector,
          RegularResourceUsageTrackingfeatures and
          ExperimentalResourceUsageTracking features.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-node]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[NodeFeature:RuntimeHandler\\]|\
                \\[Feature:PodGarbageCollector\\]|\
                \\[Feature:RegularResourceUsageTracking\\]|\
                \\[Feature:ExperimentalResourceUsageTracking\\]|\
                RuntimeClass"
      - case_name: sig_instrumentation
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-instrumentation testing excluding
          Conformance (part of k8s_conformance)
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-instrumentation\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]"
      - case_name: sig_storage
        project_name: functest
        criteria: 100
        blocking: false
        description: >-
          It runs the remaining sig-storage testing excluding the
          following labels: Conformance (part of k8s_conformance),
          all features, all drivers, PersistentVolumes.NFS and Slow.
        dependencies:
          - DEPLOY_SCENARIO: "k8-*"
        run:
          name: e2e_testing
          args:
            nodes: 25
            ginkgo:
              focus: \[sig-storage\]
              skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
                \\[Serial\\]|\\[Conformance\\]|\
                \\[Feature:.+\\]|\\[Driver:.+\\]|\
                PersistentVolumes.NFS|\\[Slow\\]"