Skip to content

Commit bcd6ea1

Browse files
feat(dataflow): update the api
#### dataflow:v1b3 The following keys were added: - schemas.SdkHarnessContainerImage.properties.capabilities (Total Keys: 2) - schemas.SendDebugCaptureRequest.properties.dataFormat.type (Total Keys: 1)
1 parent 93195a6 commit bcd6ea1

8 files changed

+85
-4
lines changed

docs/dyn/dataflow_v1b3.projects.jobs.debug.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -128,9 +128,10 @@ <h3>Method Details</h3>
128128
body: object, The request body.
129129
The object takes the form of:
130130

131-
{ # Request to send encoded debug information.
131+
{ # Request to send encoded debug information. Next ID: 8
132132
&quot;componentId&quot;: &quot;A String&quot;, # The internal component id for which debug information is sent.
133133
&quot;data&quot;: &quot;A String&quot;, # The encoded debug information.
134+
&quot;dataFormat&quot;: &quot;A String&quot;, # Format for the data field above (id=5).
134135
&quot;location&quot;: &quot;A String&quot;, # The [regional endpoint] (https://cloud.google.com/dataflow/docs/concepts/regional-endpoints) that contains the job specified by job_id.
135136
&quot;workerId&quot;: &quot;A String&quot;, # The worker id, i.e., VM hostname.
136137
}

docs/dyn/dataflow_v1b3.projects.jobs.html

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -229,6 +229,9 @@ <h3>Method Details</h3>
229229
},
230230
&quot;sdkHarnessContainerImages&quot;: [ # Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.
231231
{ # Defines a SDK harness container for executing Dataflow pipelines.
232+
&quot;capabilities&quot;: [ # The set of capabilities enumerated in the above Environment proto. See also https://github.com/apache/beam/blob/master/model/pipeline/src/main/proto/beam_runner_api.proto
233+
&quot;A String&quot;,
234+
],
232235
&quot;containerImage&quot;: &quot;A String&quot;, # A docker container image that resides in Google Container Registry.
233236
&quot;environmentId&quot;: &quot;A String&quot;, # Environment ID for the Beam runner API proto Environment that corresponds to the current SDK Harness.
234237
&quot;useSingleCorePerContainer&quot;: True or False, # If true, recommends the Dataflow service to use only one core per SDK container instance with this image. If false (or unset) recommends using more than one core per SDK container instance with this image for efficiency. Note that Dataflow service may choose to override this property if needed.
@@ -558,6 +561,9 @@ <h3>Method Details</h3>
558561
},
559562
&quot;sdkHarnessContainerImages&quot;: [ # Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.
560563
{ # Defines a SDK harness container for executing Dataflow pipelines.
564+
&quot;capabilities&quot;: [ # The set of capabilities enumerated in the above Environment proto. See also https://github.com/apache/beam/blob/master/model/pipeline/src/main/proto/beam_runner_api.proto
565+
&quot;A String&quot;,
566+
],
561567
&quot;containerImage&quot;: &quot;A String&quot;, # A docker container image that resides in Google Container Registry.
562568
&quot;environmentId&quot;: &quot;A String&quot;, # Environment ID for the Beam runner API proto Environment that corresponds to the current SDK Harness.
563569
&quot;useSingleCorePerContainer&quot;: True or False, # If true, recommends the Dataflow service to use only one core per SDK container instance with this image. If false (or unset) recommends using more than one core per SDK container instance with this image for efficiency. Note that Dataflow service may choose to override this property if needed.
@@ -871,6 +877,9 @@ <h3>Method Details</h3>
871877
},
872878
&quot;sdkHarnessContainerImages&quot;: [ # Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.
873879
{ # Defines a SDK harness container for executing Dataflow pipelines.
880+
&quot;capabilities&quot;: [ # The set of capabilities enumerated in the above Environment proto. See also https://github.com/apache/beam/blob/master/model/pipeline/src/main/proto/beam_runner_api.proto
881+
&quot;A String&quot;,
882+
],
874883
&quot;containerImage&quot;: &quot;A String&quot;, # A docker container image that resides in Google Container Registry.
875884
&quot;environmentId&quot;: &quot;A String&quot;, # Environment ID for the Beam runner API proto Environment that corresponds to the current SDK Harness.
876885
&quot;useSingleCorePerContainer&quot;: True or False, # If true, recommends the Dataflow service to use only one core per SDK container instance with this image. If false (or unset) recommends using more than one core per SDK container instance with this image for efficiency. Note that Dataflow service may choose to override this property if needed.
@@ -1191,6 +1200,9 @@ <h3>Method Details</h3>
11911200
},
11921201
&quot;sdkHarnessContainerImages&quot;: [ # Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.
11931202
{ # Defines a SDK harness container for executing Dataflow pipelines.
1203+
&quot;capabilities&quot;: [ # The set of capabilities enumerated in the above Environment proto. See also https://github.com/apache/beam/blob/master/model/pipeline/src/main/proto/beam_runner_api.proto
1204+
&quot;A String&quot;,
1205+
],
11941206
&quot;containerImage&quot;: &quot;A String&quot;, # A docker container image that resides in Google Container Registry.
11951207
&quot;environmentId&quot;: &quot;A String&quot;, # Environment ID for the Beam runner API proto Environment that corresponds to the current SDK Harness.
11961208
&quot;useSingleCorePerContainer&quot;: True or False, # If true, recommends the Dataflow service to use only one core per SDK container instance with this image. If false (or unset) recommends using more than one core per SDK container instance with this image for efficiency. Note that Dataflow service may choose to override this property if needed.
@@ -1568,6 +1580,9 @@ <h3>Method Details</h3>
15681580
},
15691581
&quot;sdkHarnessContainerImages&quot;: [ # Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.
15701582
{ # Defines a SDK harness container for executing Dataflow pipelines.
1583+
&quot;capabilities&quot;: [ # The set of capabilities enumerated in the above Environment proto. See also https://github.com/apache/beam/blob/master/model/pipeline/src/main/proto/beam_runner_api.proto
1584+
&quot;A String&quot;,
1585+
],
15711586
&quot;containerImage&quot;: &quot;A String&quot;, # A docker container image that resides in Google Container Registry.
15721587
&quot;environmentId&quot;: &quot;A String&quot;, # Environment ID for the Beam runner API proto Environment that corresponds to the current SDK Harness.
15731588
&quot;useSingleCorePerContainer&quot;: True or False, # If true, recommends the Dataflow service to use only one core per SDK container instance with this image. If false (or unset) recommends using more than one core per SDK container instance with this image for efficiency. Note that Dataflow service may choose to override this property if needed.
@@ -1938,6 +1953,9 @@ <h3>Method Details</h3>
19381953
},
19391954
&quot;sdkHarnessContainerImages&quot;: [ # Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.
19401955
{ # Defines a SDK harness container for executing Dataflow pipelines.
1956+
&quot;capabilities&quot;: [ # The set of capabilities enumerated in the above Environment proto. See also https://github.com/apache/beam/blob/master/model/pipeline/src/main/proto/beam_runner_api.proto
1957+
&quot;A String&quot;,
1958+
],
19411959
&quot;containerImage&quot;: &quot;A String&quot;, # A docker container image that resides in Google Container Registry.
19421960
&quot;environmentId&quot;: &quot;A String&quot;, # Environment ID for the Beam runner API proto Environment that corresponds to the current SDK Harness.
19431961
&quot;useSingleCorePerContainer&quot;: True or False, # If true, recommends the Dataflow service to use only one core per SDK container instance with this image. If false (or unset) recommends using more than one core per SDK container instance with this image for efficiency. Note that Dataflow service may choose to override this property if needed.
@@ -2244,6 +2262,9 @@ <h3>Method Details</h3>
22442262
},
22452263
&quot;sdkHarnessContainerImages&quot;: [ # Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.
22462264
{ # Defines a SDK harness container for executing Dataflow pipelines.
2265+
&quot;capabilities&quot;: [ # The set of capabilities enumerated in the above Environment proto. See also https://github.com/apache/beam/blob/master/model/pipeline/src/main/proto/beam_runner_api.proto
2266+
&quot;A String&quot;,
2267+
],
22472268
&quot;containerImage&quot;: &quot;A String&quot;, # A docker container image that resides in Google Container Registry.
22482269
&quot;environmentId&quot;: &quot;A String&quot;, # Environment ID for the Beam runner API proto Environment that corresponds to the current SDK Harness.
22492270
&quot;useSingleCorePerContainer&quot;: True or False, # If true, recommends the Dataflow service to use only one core per SDK container instance with this image. If false (or unset) recommends using more than one core per SDK container instance with this image for efficiency. Note that Dataflow service may choose to override this property if needed.

docs/dyn/dataflow_v1b3.projects.locations.flexTemplates.html

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -280,6 +280,9 @@ <h3>Method Details</h3>
280280
},
281281
&quot;sdkHarnessContainerImages&quot;: [ # Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.
282282
{ # Defines a SDK harness container for executing Dataflow pipelines.
283+
&quot;capabilities&quot;: [ # The set of capabilities enumerated in the above Environment proto. See also https://github.com/apache/beam/blob/master/model/pipeline/src/main/proto/beam_runner_api.proto
284+
&quot;A String&quot;,
285+
],
283286
&quot;containerImage&quot;: &quot;A String&quot;, # A docker container image that resides in Google Container Registry.
284287
&quot;environmentId&quot;: &quot;A String&quot;, # Environment ID for the Beam runner API proto Environment that corresponds to the current SDK Harness.
285288
&quot;useSingleCorePerContainer&quot;: True or False, # If true, recommends the Dataflow service to use only one core per SDK container instance with this image. If false (or unset) recommends using more than one core per SDK container instance with this image for efficiency. Note that Dataflow service may choose to override this property if needed.

docs/dyn/dataflow_v1b3.projects.locations.jobs.debug.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -130,9 +130,10 @@ <h3>Method Details</h3>
130130
body: object, The request body.
131131
The object takes the form of:
132132

133-
{ # Request to send encoded debug information.
133+
{ # Request to send encoded debug information. Next ID: 8
134134
&quot;componentId&quot;: &quot;A String&quot;, # The internal component id for which debug information is sent.
135135
&quot;data&quot;: &quot;A String&quot;, # The encoded debug information.
136+
&quot;dataFormat&quot;: &quot;A String&quot;, # Format for the data field above (id=5).
136137
&quot;location&quot;: &quot;A String&quot;, # The [regional endpoint] (https://cloud.google.com/dataflow/docs/concepts/regional-endpoints) that contains the job specified by job_id.
137138
&quot;workerId&quot;: &quot;A String&quot;, # The worker id, i.e., VM hostname.
138139
}

0 commit comments

Comments
 (0)