5 A set of conformance tests integrated from kubernetes project.
7 - case_name: xrally_kubernetes
12 All in one tasks for checking basic functionality of
15 - DEPLOY_SCENARIO: "k8-*"
17 name: xrally_kubernetes
18 - case_name: k8s_conformance
19 project_name: functest
23 Conformance Tests are expect to pass on any Kubernetes
24 cluster, this tests are necessary demonstrate conformance
25 of the Kubernetes deployment.
27 - DEPLOY_SCENARIO: "k8-*"
33 focus: \[Conformance\]
34 skip: \[Serial\]|\[Disruptive\]|NoExecuteTaintManager
35 - case_name: k8s_conformance_serial
36 project_name: functest
40 Conformance Tests are expect to pass on any Kubernetes
41 cluster, this tests are necessary demonstrate conformance
42 of the Kubernetes deployment.
44 - DEPLOY_SCENARIO: "k8-*"
49 focus: \[Serial\].*\[Conformance\]
50 skip: \[Disruptive\]|NoExecuteTaintManager
51 - case_name: sig_api_machinery
52 project_name: functest
56 It runs the remaining sig-api-machinery testing excluding
57 the label Conformance (part of k8s_conformance) and a few features.
59 - DEPLOY_SCENARIO: "k8-*"
65 focus: \[sig-api-machinery\]
66 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
67 \\[Serial\\]|\\[Conformance\\]|\
68 \\[Feature:CrossNamespacePodAffinity]|\
69 \\[Feature:CustomResourceValidationExpressions]|\
70 \\[Feature:StorageVersionAPI\\]|\
71 \\[Feature:WatchList\\]"
72 - case_name: sig_api_machinery_serial
73 project_name: functest
77 It runs the remaining sig-api-machinery testing excluding
78 the label Conformance (part of k8s_conformance) and a few features.
80 - DEPLOY_SCENARIO: "k8-*"
85 focus: \[sig-api-machinery\].*\[Serial\]
86 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
88 \\[Feature:CrossNamespacePodAffinity]|\
89 \\[Feature:StorageVersionAPI\\]|\
90 \\[Feature:WatchList\\]"
92 project_name: functest
96 It runs the remaining sig-apps testing excluding
97 the label Conformance (part of k8s_conformance) and a few features.
99 - DEPLOY_SCENARIO: "k8-*"
106 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
107 \\[Serial\\]|\\[Conformance\\]|\
108 \\[Feature:DaemonSetUpdateSurge\\]|\
109 \\[Feature:IndexedJob\\]|\
110 \\[Feature:StatefulSet\\]|\
111 \\[Feature:StatefulSetAutoDeletePVC\\]|\
112 \\[Feature:StatefulUpgrade\\]|\
113 \\[Feature:SuspendJob\\]"
114 - case_name: sig_apps_serial
115 project_name: functest
119 It runs the remaining sig-apps testing excluding
120 the label Conformance (part of k8s_conformance) and a few features.
122 - DEPLOY_SCENARIO: "k8-*"
127 focus: \[sig-apps].*\[Serial\]
128 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
130 \\[Feature:DaemonSetUpdateSurge\\]|\
131 \\[Feature:IndexedJob\\]|\
132 \\[Feature:StatefulSet\\]|\
133 \\[Feature:StatefulUpgrade\\]|\
134 \\[Feature:SuspendJob\\]"
135 - case_name: sig_auth
136 project_name: functest
140 It runs the remaining sig-auth testing excluding
141 the label Conformance (part of k8s_conformance) and a few features.
144 - DEPLOY_SCENARIO: "k8-*"
151 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
152 \\[Serial\\]|\\[Conformance\\]|\
153 \\[Feature:ClusterTrustBundle\\]|\
154 \\[Feature:PodSecurityPolicy\\]|\
155 \\[Feature:BoundServiceAccountTokenVolume\\]"
156 - case_name: sig_cluster_lifecycle
157 project_name: functest
161 It runs the remaining sig-cluster-lifecycle testing
162 excluding Conformance (part of k8s_conformance).
164 - DEPLOY_SCENARIO: "k8-*"
170 focus: \[sig-cluster-lifecycle\]
171 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
172 \\[Serial\\]|\\[Conformance\\]"
173 - case_name: sig_instrumentation
174 project_name: functest
178 It runs the remaining sig-instrumentation testing excluding
179 the label Conformance (part of k8s_conformance) and a few features.
181 - DEPLOY_SCENARIO: "k8-*"
187 focus: \[sig-instrumentation\]
188 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
189 \\[Serial\\]|\\[Conformance\\]|\\[Feature:Elasticsearch\\]|\
190 \\[Feature:StackdriverAcceleratorMonitoring\\]|\
191 \\[Feature:StackdriverCustomMetrics\\]|\
192 \\[Feature:StackdriverExternalMetrics\\]|\
193 \\[Feature:StackdriverMetadataAgent\\]|\
194 \\[Feature:StackdriverMonitoring\\]"
195 - case_name: sig_network
196 project_name: functest
200 It runs the remaining sig-network testing excluding
201 the label Conformance (part of k8s_conformance) and a few features.
203 - DEPLOY_SCENARIO: "k8-*"
209 focus: \[sig-network\]
210 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
211 \\[Serial\\]|\\[Conformance\\]|\
212 \\[Feature:Example\\]|\
213 \\[Feature:Ingress\\]|\
214 \\[Feature:IPv6DualStack\\]|\
215 \\[Feature:kubemci\\]|\
216 \\[Feature:KubeProxyDaemonSetMigration\\]|\
217 \\[Feature:KubeProxyDaemonSetUpgrade\\]|\
219 \\[Feature:Networking-IPv6\\]|\
220 \\[Feature:NetworkPolicy\\]|\
221 \\[Feature:PerformanceDNS\\]|\
222 \\[Feature:ProxyTerminatingEndpoints\\]|\
224 \\[Feature:SCTPConnectivity\\]|\
225 \\[Feature:ServiceCIDRs\\]|\
226 DNS configMap nameserver|\
227 load.balancer|LoadBalancer|\
228 Network.should.set.TCP.CLOSE_WAIT.timeout"
229 - case_name: sig_node
230 project_name: functest
234 It runs the remaining sig-node testing excluding
235 the label Conformance (part of k8s_conformance) and a few features.
237 - DEPLOY_SCENARIO: "k8-*"
244 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
245 \\[Serial\\]|\\[Conformance\\]|\
246 \\[Feature:DynamicResourceAllocation\\]|\
247 \\[Feature:ExperimentalResourceUsageTracking\\]|\
248 \\[Feature:GRPCContainerProbe\\]|\
249 \\[Feature:GPUUpgrade\\]|\
250 \\[Feature:InPlacePodVerticalScaling\\]|\
251 \\[Feature:NodeLogQuery\\]|\
252 \\[Feature:PodGarbageCollector\\]|\
253 \\[Feature:RegularResourceUsageTracking\\]|\
254 \\[Feature:SidecarContainers\\]|\
255 \\[Feature:UserNamespacesSupport\\]|\
256 \\[Feature:UserNamespacesStatelessPodsSupport\\]|\
257 \\[NodeFeature:DownwardAPIHugePages\\]|\
258 \\[NodeFeature:RuntimeHandler\\]"
259 - case_name: sig_scheduling_serial
260 project_name: functest
264 It runs the remaining sig-network testing excluding
265 the label Conformance (part of k8s_conformance) and a few features.
267 - DEPLOY_SCENARIO: 'k8-*'
272 focus: \[sig-scheduling\].*\[Serial\]
273 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
275 \\[Feature:GPUDevicePlugin\\]|\\[Feature:Recreate\\]"
276 - case_name: sig_storage
277 project_name: functest
281 It runs the remaining sig-storage testing excluding
282 the label Conformance (part of k8s_conformance) and a few features.
284 - DEPLOY_SCENARIO: "k8-*"
290 focus: \[sig-storage\]
291 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
292 \\[Conformance\\]|\\[Driver:.+\\]|\
293 \\[Feature:ExpandInUsePersistentVolumes\\]|\
294 \\[Feature:Flexvolumes\\]|\
295 \\[Feature:GKELocalSSD\\]|\
296 \\[Feature:VolumeSnapshotDataSource\\]|\
297 \\[Feature:Flexvolumes\\]|\
298 \\[Feature:RecoverVolumeExpansionFailure\\]|\
299 \\[Feature:SELinux\\]|\
300 \\[Feature:vsphere\\]|\
301 \\[Feature:Volumes\\]|\
302 \\[Feature:Windows\\]|\
303 \\[NodeFeature:EphemeralStorage\\]|\
304 PersistentVolumes.NFS|\
305 should provision storage with different parameters|\
306 should not cause race condition when used for git_repo"
307 - case_name: sig_storage_serial
308 project_name: functest
312 It runs the remaining sig-storage testing excluding
313 the label Conformance (part of k8s_conformance) and a few features.
315 - DEPLOY_SCENARIO: "k8-*"
320 focus: \[sig-storage\].*\[Serial\]
321 skip: "\\[Disruptive\\]|\\[Flaky\\]|\\[alpha\\]|\
322 \\[Conformance\\]|\\[Driver:.+\\]|\
323 \\[Feature:ExpandInUsePersistentVolumes\\]|\
324 \\[Feature:Flexvolumes\\]|\
325 \\[Feature:GKELocalSSD\\]|\
326 \\[Feature:VolumeSnapshotDataSource\\]|\
327 \\[Feature:Flexvolumes\\]|\
328 \\[Feature:RecoverVolumeExpansionFailure\\]|\
329 \\[Feature:SELinux\\]|\
330 \\[Feature:vsphere\\]|\
331 \\[Feature:Volumes\\]|\
332 \\[Feature:Windows\\]|\
333 \\[NodeFeature:EphemeralStorage\\]|\
334 PersistentVolumes.NFS|\
335 should provision storage with different parameters|\
336 should not cause race condition when used for git_repo"