5 A set of conformance tests integrated from kubernetes project.
7 - case_name: xrally_kubernetes
12 All in one tasks for checking basic functionality of
15 - DEPLOY_SCENARIO: "k8-*"
17 name: xrally_kubernetes
18 - case_name: k8s_conformance
19 project_name: functest
23 Conformance Tests are expect to pass on any Kubernetes
24 cluster, this tests are necessary demonstrate conformance
25 of the Kubernetes deployment.
27 - DEPLOY_SCENARIO: "k8-*"
33 focus: \[Conformance\]
34 skip: \[Serial\]|\[Disruptive\]|NoExecuteTaintManager
35 - case_name: k8s_conformance_serial
36 project_name: functest
40 Conformance Tests are expect to pass on any Kubernetes
41 cluster, this tests are necessary demonstrate conformance
42 of the Kubernetes deployment.
44 - DEPLOY_SCENARIO: "k8-*"
49 focus: \[Serial\].*\[Conformance\]
50 skip: \[Disruptive\]|NoExecuteTaintManager
51 - case_name: sig_api_machinery
52 project_name: functest
56 It runs the remaining sig-api-machinery testing excluding
57 the label Conformance (part of k8s_conformance) and
60 - DEPLOY_SCENARIO: "k8-*"
66 focus: \[sig-api-machinery\]
67 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
68 \\[Serial\\]|\\[Conformance\\]|\
69 \\[Feature:StorageVersionAPI\\]"
70 - case_name: sig_api_machinery_serial
71 project_name: functest
75 It runs the remaining sig-api-machinery testing excluding
76 the label Conformance (part of k8s_conformance) and
79 - DEPLOY_SCENARIO: "k8-*"
84 focus: \[sig-api-machinery\].*\[Serial\]
85 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
87 \\[Feature:StorageVersionAPI\\]"
89 project_name: functest
93 It runs the remaining sig-apps testing excluding the
94 following labels: Conformance (part of k8s_conformance) and
95 both StatefulUpgrade and StatefulSet features.
97 - DEPLOY_SCENARIO: "k8-*"
104 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
105 \\[Serial\\]|\\[Conformance\\]|\
106 \\[Feature:StatefulUpgrade\\]|\
107 \\[Feature:StatefulSet\\]"
108 - case_name: sig_apps_serial
109 project_name: functest
113 It runs the remaining sig-apps testing excluding the
114 following labels: Conformance (part of k8s_conformance) and
115 both StatefulUpgrade and StatefulSet features.
117 - DEPLOY_SCENARIO: "k8-*"
122 focus: \[sig-apps].*\[Serial\]
123 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
125 \\[Feature:StatefulUpgrade\\]|\
126 \\[Feature:StatefulSet\\]"
127 - case_name: sig_auth
128 project_name: functest
132 It runs the remaining sig-auth testing excluding the
133 following labels: Conformance (part of k8s_conformance) and
134 both PodSecurityPolicy and BoundServiceAccountTokenVolume
137 - DEPLOY_SCENARIO: "k8-*"
144 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
145 \\[Serial\\]|\\[Conformance\\]|\
146 \\[Feature:PodSecurityPolicy\\]|\
147 \\[Feature:BoundServiceAccountTokenVolume\\]"
149 project_name: functest
153 It runs the remaining sig-cli testing excluding Conformance
154 (part of k8s_conformance).
156 - DEPLOY_SCENARIO: "k8-*"
163 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
164 \\[Serial\\]|\\[Conformance\\]"
165 - case_name: sig_cli_serial
166 project_name: functest
170 It runs the remaining sig-cli testing excluding Conformance
171 (part of k8s_conformance).
173 - DEPLOY_SCENARIO: "k8-*"
178 focus: \[sig-cli].*\[Serial\]
179 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
181 - case_name: sig_cluster_lifecycle
182 project_name: functest
186 It runs the remaining sig-cluster-lifecycle testing
187 excluding Conformance (part of k8s_conformance).
189 - DEPLOY_SCENARIO: "k8-*"
195 focus: \[sig-cluster-lifecycle\]
196 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
197 \\[Serial\\]|\\[Conformance\\]"
198 - case_name: sig_instrumentation
199 project_name: functest
203 It runs the remaining sig-instrumentation testing excluding
204 Conformance (part of k8s_conformance)
206 - DEPLOY_SCENARIO: "k8-*"
212 focus: \[sig-instrumentation\]
213 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
214 \\[Serial\\]|\\[Conformance\\]"
215 - case_name: sig_network
216 project_name: functest
220 It runs the remaining sig-network testing excluding the
221 following labels: Conformance (part of k8s_conformance),
222 load.balancer, NetworkPolicy, Networking-IPv6,
223 IPv6DualStackAlphaFeature, SCTP and Example. A couple of features may
224 be automatically skipped like NEG and kubemci.
226 - DEPLOY_SCENARIO: "k8-*"
232 focus: \[sig-network\]
233 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
234 \\[Serial\\]|\\[Conformance\\]|load.balancer|\
235 LoadBalancer|\\[Feature:NetworkPolicy\\]|\
236 \\[Feature:Networking-IPv6\\]|\
237 \\[Feature:IPv6DualStackAlphaFeature\\]|\
238 \\[Feature:SCTP\\]|\\[Feature:Example\\]|\
239 Network.should.set.TCP.CLOSE_WAIT.timeout"
240 - case_name: sig_network_serial
241 project_name: functest
245 It runs the remaining sig-network testing excluding the
246 following labels: Conformance (part of k8s_conformance),
247 load.balancer, NetworkPolicy, Networking-IPv6,
248 IPv6DualStackAlphaFeature, SCTP and Example. A couple of features may
249 be automatically skipped like NEG and kubemci.
251 - DEPLOY_SCENARIO: "k8-*"
256 focus: \[sig-network\].*\[Serial\]
257 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
258 \\[Conformance\\]|load.balancer|\
259 LoadBalancer|\\[Feature:NetworkPolicy\\]|\
260 \\[Feature:SCTP\\]|\\[Feature:Example\\]"
261 - case_name: sig_node
262 project_name: functest
266 It runs the remaining sig-node testing excluding the
267 following labels: Conformance (part of k8s_conformance),
268 RuntimeClass, all RuntimeHandler, PodGarbageCollector,
269 RegularResourceUsageTrackingfeatures and
270 ExperimentalResourceUsageTracking features.
272 - DEPLOY_SCENARIO: "k8-*"
279 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
280 \\[Serial\\]|\\[Conformance\\]|\
281 \\[NodeFeature:RuntimeHandler\\]|\
282 \\[Feature:PodGarbageCollector\\]|\
283 \\[Feature:RegularResourceUsageTracking\\]|\
284 \\[Feature:ExperimentalResourceUsageTracking\\]|\
286 - case_name: sig_scheduling_serial
287 project_name: functest
291 It runs the remaining sig-network testing excluding the
292 next labels: Conformance (part of k8s_conformance) and the
293 GPUDevicePlugin feature.
295 - DEPLOY_SCENARIO: 'k8-*'
300 focus: \[sig-scheduling\].*\[Serial\]
301 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
303 \\[Feature:GPUDevicePlugin\\]"
304 - case_name: sig_storage
305 project_name: functest
309 It runs the remaining sig-storage testing excluding the
310 following labels: Conformance (part of k8s_conformance),
311 all features, all drivers, PersistentVolumes.NFS and Slow.
313 - DEPLOY_SCENARIO: "k8-*"
319 focus: \[sig-storage\]
320 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
321 \\[Serial\\]|\\[Conformance\\]|\
322 \\[Feature:.+\\]|\\[Driver:.+\\]|\
323 PersistentVolumes.NFS|\\[Slow\\]"
324 - case_name: sig_storage_serial
325 project_name: functest
329 It runs the remaining sig-storage testing excluding the
330 following labels: Conformance (part of k8s_conformance),
331 all features, all drivers, PersistentVolumes.NFS and Slow.
333 - DEPLOY_SCENARIO: "k8-*"
338 focus: \[sig-storage\].*\[Serial\]
339 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
341 \\[Feature:.+\\]|\\[Driver:.+\\]|\
342 PersistentVolumes.NFS|\\[Slow\\]"