run:
name: e2e_testing
args:
+ nodes: 10
ginkgo:
focus: \[Conformance\]
+ skip: \[Serial\]|\[Disruptive\]|NoExecuteTaintManager
+ - case_name: k8s_conformance_serial
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ Conformance Tests are expect to pass on any Kubernetes
+ cluster, this tests are necessary demonstrate conformance
+ of the Kubernetes deployment.
+ dependencies:
+ - DEPLOY_SCENARIO: "k8-*"
+ run:
+ name: e2e_testing
+ args:
+ ginkgo:
+ focus: \[Serial\].*\[Conformance\]
skip: \[Disruptive\]|NoExecuteTaintManager
- case_name: sig_api_machinery
project_name: functest
run:
name: e2e_testing
args:
- nodes: 25
+ nodes: 10
ginkgo:
focus: \[sig-api-machinery\]
skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
\\[Serial\\]|\\[Conformance\\]|\
\\[Feature:StorageVersionAPI\\]"
+ - case_name: sig_api_machinery_serial
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ It runs the remaining sig-api-machinery testing excluding
+ the label Conformance (part of k8s_conformance) and
+ StorageVersionAPI.
+ dependencies:
+ - DEPLOY_SCENARIO: "k8-*"
+ run:
+ name: e2e_testing
+ args:
+ ginkgo:
+ focus: \[sig-api-machinery\].*\[Serial\]
+ skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
+ \\[Conformance\\]|\
+ \\[Feature:StorageVersionAPI\\]"
- case_name: sig_apps
project_name: functest
criteria: 100
run:
name: e2e_testing
args:
- nodes: 25
+ nodes: 10
ginkgo:
focus: \[sig-apps]
skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
\\[Serial\\]|\\[Conformance\\]|\
+ \\[Feature:IndexedJob\\]|\
+ \\[Feature:SuspendJob\\]|\
\\[Feature:StatefulUpgrade\\]|\
\\[Feature:StatefulSet\\]"
+ - case_name: sig_apps_serial
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ It runs the remaining sig-apps testing excluding the
+ following labels: Conformance (part of k8s_conformance) and
+ both StatefulUpgrade and StatefulSet features.
+ dependencies:
+ - DEPLOY_SCENARIO: "k8-*"
+ run:
+ name: e2e_testing
+ args:
+ ginkgo:
+ focus: \[sig-apps].*\[Serial\]
+ skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
+ \\[Conformance\\]|\
+ \\[Feature:StatefulUpgrade\\]|\
+ \\[Feature:DaemonSetUpdateSurge\\]|\
+ \\[Feature:StatefulSet\\]"
- case_name: sig_auth
project_name: functest
criteria: 100
run:
name: e2e_testing
args:
- nodes: 25
+ nodes: 10
ginkgo:
focus: \[sig-auth\]
skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
run:
name: e2e_testing
args:
- nodes: 25
+ nodes: 10
ginkgo:
focus: \[sig-cli]
skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
\\[Serial\\]|\\[Conformance\\]"
+ - case_name: sig_cli_serial
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ It runs the remaining sig-cli testing excluding Conformance
+ (part of k8s_conformance).
+ dependencies:
+ - DEPLOY_SCENARIO: "k8-*"
+ run:
+ name: e2e_testing
+ args:
+ ginkgo:
+ focus: \[sig-cli].*\[Serial\]
+ skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
+ \\[Conformance\\]"
- case_name: sig_cluster_lifecycle
project_name: functest
criteria: 100
run:
name: e2e_testing
args:
- nodes: 25
+ nodes: 10
ginkgo:
focus: \[sig-cluster-lifecycle\]
skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
\\[Serial\\]|\\[Conformance\\]"
+ - case_name: sig_instrumentation
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ It runs the remaining sig-instrumentation testing excluding
+ Conformance (part of k8s_conformance)
+ dependencies:
+ - DEPLOY_SCENARIO: "k8-*"
+ run:
+ name: e2e_testing
+ args:
+ nodes: 10
+ ginkgo:
+ focus: \[sig-instrumentation\]
+ skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
+ \\[Serial\\]|\\[Conformance\\]"
- case_name: sig_network
project_name: functest
criteria: 100
description: >-
It runs the remaining sig-network testing excluding the
following labels: Conformance (part of k8s_conformance),
- all features and load.balancer.
+ load.balancer, NetworkPolicy, Networking-IPv6,
+ IPv6DualStackAlphaFeature, SCTP and Example. A couple of features may
+ be automatically skipped like NEG and kubemci.
dependencies:
- DEPLOY_SCENARIO: "k8-*"
run:
name: e2e_testing
args:
- nodes: 25
+ nodes: 10
ginkgo:
focus: \[sig-network\]
skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
\\[Serial\\]|\\[Conformance\\]|load.balancer|\
- LoadBalancer|\\[Feature:.+\\]"
- - case_name: sig_network_features
+ LoadBalancer|\\[Feature:NetworkPolicy\\]|\
+ \\[Feature:Networking-IPv6\\]|\
+ \\[Feature:IPv6DualStack\\]|\
+ \\[Feature:SCTP\\]|\\[Feature:Example\\]|\
+ Network.should.set.TCP.CLOSE_WAIT.timeout"
+ - case_name: sig_network_serial
project_name: functest
criteria: 100
blocking: false
description: >-
- It verifies a couple of features by running a subset of e2e
- tests: Ingress, Networking-IPv4, Networking-Performance,
- PerformanceDNS and NoSNAT. It excludes by default
- NetworkPolicy, Networking-IPv6, IPv6DualStackAlphaFeature,
- SCTP and Example. A couple of features may be automatically
- skipped like NEG and kubemci.
+ It runs the remaining sig-network testing excluding the
+ following labels: Conformance (part of k8s_conformance),
+ load.balancer, NetworkPolicy, Networking-IPv6,
+ IPv6DualStackAlphaFeature, SCTP and Example. A couple of features may
+ be automatically skipped like NEG and kubemci.
dependencies:
- DEPLOY_SCENARIO: "k8-*"
run:
name: e2e_testing
args:
- nodes: 25
ginkgo:
- focus: "\\[Feature:Ingress\\]|\
- \\[Feature:Networking-IPv4\\]|\
- \\[Feature:Networking-Performance\\]|\
- \\[Feature:PerformanceDNS\\]|\\[Feature:NoSNAT\\]"
+ focus: \[sig-network\].*\[Serial\]
skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
- \\[Serial\\]|\\[Conformance\\]|\
- \\[Feature:NetworkPolicy\\]|\
- \\[Feature:Networking-IPv6\\]|\
- \\[Feature:IPv6DualStackAlphaFeature\\]|\
+ \\[Conformance\\]|load.balancer|\
+ LoadBalancer|\\[Feature:NetworkPolicy\\]|\
\\[Feature:SCTP\\]|\\[Feature:Example\\]"
- case_name: sig_node
project_name: functest
run:
name: e2e_testing
args:
- nodes: 25
+ nodes: 10
ginkgo:
focus: \[sig-node]
skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
\\[NodeFeature:RuntimeHandler\\]|\
\\[Feature:PodGarbageCollector\\]|\
\\[Feature:RegularResourceUsageTracking\\]|\
+ \\[Feature:GPUUpgrade\\]|\
\\[Feature:ExperimentalResourceUsageTracking\\]|\
RuntimeClass"
- - case_name: sig_instrumentation
+ - case_name: sig_scheduling_serial
project_name: functest
criteria: 100
blocking: false
description: >-
- It runs the remaining sig-instrumentation testing excluding
- Conformance (part of k8s_conformance)
+ It runs the remaining sig-network testing excluding the
+ next labels: Conformance (part of k8s_conformance) and the
+ GPUDevicePlugin feature.
dependencies:
- - DEPLOY_SCENARIO: "k8-*"
+ - DEPLOY_SCENARIO: 'k8-*'
run:
name: e2e_testing
args:
- nodes: 25
ginkgo:
- focus: \[sig-instrumentation\]
+ focus: \[sig-scheduling\].*\[Serial\]
skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
- \\[Serial\\]|\\[Conformance\\]"
+ \\[Conformance\\]|\
+ \\[Feature:GPUDevicePlugin\\]"
- case_name: sig_storage
project_name: functest
criteria: 100
run:
name: e2e_testing
args:
- nodes: 25
+ nodes: 10
ginkgo:
focus: \[sig-storage\]
skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
\\[Serial\\]|\\[Conformance\\]|\
\\[Feature:.+\\]|\\[Driver:.+\\]|\
PersistentVolumes.NFS|\\[Slow\\]"
+ - case_name: sig_storage_serial
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: >-
+ It runs the remaining sig-storage testing excluding the
+ following labels: Conformance (part of k8s_conformance),
+ all features, all drivers, PersistentVolumes.NFS and Slow.
+ dependencies:
+ - DEPLOY_SCENARIO: "k8-*"
+ run:
+ name: e2e_testing
+ args:
+ ginkgo:
+ focus: \[sig-storage\].*\[Serial\]
+ skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
+ \\[Conformance\\]|\
+ \\[Feature:.+\\]|\\[Driver:.+\\]|\
+ PersistentVolumes.NFS|\\[Slow\\]"
Code Review / functest-kubernetes.git / blobdiff