Skip to content

Commit f78db2b

Browse files
feat(dataflow): update the api
#### dataflow:v1b3 The following keys were added: - schemas.Environment.properties.usePublicIps.type (Total Keys: 1)
1 parent c6458ad commit f78db2b

6 files changed

+23
-1
lines changed

docs/dyn/dataflow_v1b3.projects.jobs.html

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -192,6 +192,7 @@ <h3>Method Details</h3>
192192
&quot;shuffleMode&quot;: &quot;A String&quot;, # Output only. The shuffle mode used for the job.
193193
&quot;streamingMode&quot;: &quot;A String&quot;, # Optional. Specifies the Streaming Engine message processing guarantees. Reduces cost and latency but might result in duplicate messages committed to storage. Designed to run simple mapping streaming ETL jobs at the lowest cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use case. For more information, see [Set the pipeline streaming mode](https://cloud.google.com/dataflow/docs/guides/streaming-modes).
194194
&quot;tempStoragePrefix&quot;: &quot;A String&quot;, # The prefix of the resources the system should use for temporary storage. The system will append the suffix &quot;/temp-{JOBNAME} to this resource prefix, where {JOBNAME} is the value of the job_name field. The resulting bucket and object prefix is used as the prefix of the resources used to store temporary data needed during the job execution. NOTE: This will override the value in taskrunner_settings. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object}
195+
&quot;usePublicIps&quot;: True or False, # Optional. True when any worker pool that uses public IPs is present.
195196
&quot;useStreamingEngineResourceBasedBilling&quot;: True or False, # Output only. Whether the job uses the Streaming Engine resource-based billing model.
196197
&quot;userAgent&quot;: { # A description of the process that generated the request.
197198
&quot;a_key&quot;: &quot;&quot;, # Properties of the object.
@@ -553,6 +554,7 @@ <h3>Method Details</h3>
553554
&quot;shuffleMode&quot;: &quot;A String&quot;, # Output only. The shuffle mode used for the job.
554555
&quot;streamingMode&quot;: &quot;A String&quot;, # Optional. Specifies the Streaming Engine message processing guarantees. Reduces cost and latency but might result in duplicate messages committed to storage. Designed to run simple mapping streaming ETL jobs at the lowest cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use case. For more information, see [Set the pipeline streaming mode](https://cloud.google.com/dataflow/docs/guides/streaming-modes).
555556
&quot;tempStoragePrefix&quot;: &quot;A String&quot;, # The prefix of the resources the system should use for temporary storage. The system will append the suffix &quot;/temp-{JOBNAME} to this resource prefix, where {JOBNAME} is the value of the job_name field. The resulting bucket and object prefix is used as the prefix of the resources used to store temporary data needed during the job execution. NOTE: This will override the value in taskrunner_settings. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object}
557+
&quot;usePublicIps&quot;: True or False, # Optional. True when any worker pool that uses public IPs is present.
556558
&quot;useStreamingEngineResourceBasedBilling&quot;: True or False, # Output only. Whether the job uses the Streaming Engine resource-based billing model.
557559
&quot;userAgent&quot;: { # A description of the process that generated the request.
558560
&quot;a_key&quot;: &quot;&quot;, # Properties of the object.
@@ -898,6 +900,7 @@ <h3>Method Details</h3>
898900
&quot;shuffleMode&quot;: &quot;A String&quot;, # Output only. The shuffle mode used for the job.
899901
&quot;streamingMode&quot;: &quot;A String&quot;, # Optional. Specifies the Streaming Engine message processing guarantees. Reduces cost and latency but might result in duplicate messages committed to storage. Designed to run simple mapping streaming ETL jobs at the lowest cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use case. For more information, see [Set the pipeline streaming mode](https://cloud.google.com/dataflow/docs/guides/streaming-modes).
900902
&quot;tempStoragePrefix&quot;: &quot;A String&quot;, # The prefix of the resources the system should use for temporary storage. The system will append the suffix &quot;/temp-{JOBNAME} to this resource prefix, where {JOBNAME} is the value of the job_name field. The resulting bucket and object prefix is used as the prefix of the resources used to store temporary data needed during the job execution. NOTE: This will override the value in taskrunner_settings. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object}
903+
&quot;usePublicIps&quot;: True or False, # Optional. True when any worker pool that uses public IPs is present.
901904
&quot;useStreamingEngineResourceBasedBilling&quot;: True or False, # Output only. Whether the job uses the Streaming Engine resource-based billing model.
902905
&quot;userAgent&quot;: { # A description of the process that generated the request.
903906
&quot;a_key&quot;: &quot;&quot;, # Properties of the object.
@@ -1250,6 +1253,7 @@ <h3>Method Details</h3>
12501253
&quot;shuffleMode&quot;: &quot;A String&quot;, # Output only. The shuffle mode used for the job.
12511254
&quot;streamingMode&quot;: &quot;A String&quot;, # Optional. Specifies the Streaming Engine message processing guarantees. Reduces cost and latency but might result in duplicate messages committed to storage. Designed to run simple mapping streaming ETL jobs at the lowest cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use case. For more information, see [Set the pipeline streaming mode](https://cloud.google.com/dataflow/docs/guides/streaming-modes).
12521255
&quot;tempStoragePrefix&quot;: &quot;A String&quot;, # The prefix of the resources the system should use for temporary storage. The system will append the suffix &quot;/temp-{JOBNAME} to this resource prefix, where {JOBNAME} is the value of the job_name field. The resulting bucket and object prefix is used as the prefix of the resources used to store temporary data needed during the job execution. NOTE: This will override the value in taskrunner_settings. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object}
1256+
&quot;usePublicIps&quot;: True or False, # Optional. True when any worker pool that uses public IPs is present.
12531257
&quot;useStreamingEngineResourceBasedBilling&quot;: True or False, # Output only. Whether the job uses the Streaming Engine resource-based billing model.
12541258
&quot;userAgent&quot;: { # A description of the process that generated the request.
12551259
&quot;a_key&quot;: &quot;&quot;, # Properties of the object.
@@ -1662,6 +1666,7 @@ <h3>Method Details</h3>
16621666
&quot;shuffleMode&quot;: &quot;A String&quot;, # Output only. The shuffle mode used for the job.
16631667
&quot;streamingMode&quot;: &quot;A String&quot;, # Optional. Specifies the Streaming Engine message processing guarantees. Reduces cost and latency but might result in duplicate messages committed to storage. Designed to run simple mapping streaming ETL jobs at the lowest cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use case. For more information, see [Set the pipeline streaming mode](https://cloud.google.com/dataflow/docs/guides/streaming-modes).
16641668
&quot;tempStoragePrefix&quot;: &quot;A String&quot;, # The prefix of the resources the system should use for temporary storage. The system will append the suffix &quot;/temp-{JOBNAME} to this resource prefix, where {JOBNAME} is the value of the job_name field. The resulting bucket and object prefix is used as the prefix of the resources used to store temporary data needed during the job execution. NOTE: This will override the value in taskrunner_settings. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object}
1669+
&quot;usePublicIps&quot;: True or False, # Optional. True when any worker pool that uses public IPs is present.
16651670
&quot;useStreamingEngineResourceBasedBilling&quot;: True or False, # Output only. Whether the job uses the Streaming Engine resource-based billing model.
16661671
&quot;userAgent&quot;: { # A description of the process that generated the request.
16671672
&quot;a_key&quot;: &quot;&quot;, # Properties of the object.
@@ -2064,6 +2069,7 @@ <h3>Method Details</h3>
20642069
&quot;shuffleMode&quot;: &quot;A String&quot;, # Output only. The shuffle mode used for the job.
20652070
&quot;streamingMode&quot;: &quot;A String&quot;, # Optional. Specifies the Streaming Engine message processing guarantees. Reduces cost and latency but might result in duplicate messages committed to storage. Designed to run simple mapping streaming ETL jobs at the lowest cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use case. For more information, see [Set the pipeline streaming mode](https://cloud.google.com/dataflow/docs/guides/streaming-modes).
20662071
&quot;tempStoragePrefix&quot;: &quot;A String&quot;, # The prefix of the resources the system should use for temporary storage. The system will append the suffix &quot;/temp-{JOBNAME} to this resource prefix, where {JOBNAME} is the value of the job_name field. The resulting bucket and object prefix is used as the prefix of the resources used to store temporary data needed during the job execution. NOTE: This will override the value in taskrunner_settings. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object}
2072+
&quot;usePublicIps&quot;: True or False, # Optional. True when any worker pool that uses public IPs is present.
20672073
&quot;useStreamingEngineResourceBasedBilling&quot;: True or False, # Output only. Whether the job uses the Streaming Engine resource-based billing model.
20682074
&quot;userAgent&quot;: { # A description of the process that generated the request.
20692075
&quot;a_key&quot;: &quot;&quot;, # Properties of the object.
@@ -2403,6 +2409,7 @@ <h3>Method Details</h3>
24032409
&quot;shuffleMode&quot;: &quot;A String&quot;, # Output only. The shuffle mode used for the job.
24042410
&quot;streamingMode&quot;: &quot;A String&quot;, # Optional. Specifies the Streaming Engine message processing guarantees. Reduces cost and latency but might result in duplicate messages committed to storage. Designed to run simple mapping streaming ETL jobs at the lowest cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use case. For more information, see [Set the pipeline streaming mode](https://cloud.google.com/dataflow/docs/guides/streaming-modes).
24052411
&quot;tempStoragePrefix&quot;: &quot;A String&quot;, # The prefix of the resources the system should use for temporary storage. The system will append the suffix &quot;/temp-{JOBNAME} to this resource prefix, where {JOBNAME} is the value of the job_name field. The resulting bucket and object prefix is used as the prefix of the resources used to store temporary data needed during the job execution. NOTE: This will override the value in taskrunner_settings. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object}
2412+
&quot;usePublicIps&quot;: True or False, # Optional. True when any worker pool that uses public IPs is present.
24062413
&quot;useStreamingEngineResourceBasedBilling&quot;: True or False, # Output only. Whether the job uses the Streaming Engine resource-based billing model.
24072414
&quot;userAgent&quot;: { # A description of the process that generated the request.
24082415
&quot;a_key&quot;: &quot;&quot;, # Properties of the object.

docs/dyn/dataflow_v1b3.projects.locations.flexTemplates.html

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -274,6 +274,7 @@ <h3>Method Details</h3>
274274
&quot;shuffleMode&quot;: &quot;A String&quot;, # Output only. The shuffle mode used for the job.
275275
&quot;streamingMode&quot;: &quot;A String&quot;, # Optional. Specifies the Streaming Engine message processing guarantees. Reduces cost and latency but might result in duplicate messages committed to storage. Designed to run simple mapping streaming ETL jobs at the lowest cost. For example, Change Data Capture (CDC) to BigQuery is a canonical use case. For more information, see [Set the pipeline streaming mode](https://cloud.google.com/dataflow/docs/guides/streaming-modes).
276276
&quot;tempStoragePrefix&quot;: &quot;A String&quot;, # The prefix of the resources the system should use for temporary storage. The system will append the suffix &quot;/temp-{JOBNAME} to this resource prefix, where {JOBNAME} is the value of the job_name field. The resulting bucket and object prefix is used as the prefix of the resources used to store temporary data needed during the job execution. NOTE: This will override the value in taskrunner_settings. The supported resource type is: Google Cloud Storage: storage.googleapis.com/{bucket}/{object} bucket.storage.googleapis.com/{object}
277+
&quot;usePublicIps&quot;: True or False, # Optional. True when any worker pool that uses public IPs is present.
277278
&quot;useStreamingEngineResourceBasedBilling&quot;: True or False, # Output only. Whether the job uses the Streaming Engine resource-based billing model.
278279
&quot;userAgent&quot;: { # A description of the process that generated the request.
279280
&quot;a_key&quot;: &quot;&quot;, # Properties of the object.

0 commit comments

Comments
 (0)