Skip to content

Commit a8b3400

Browse files
feat(dataflow): update the api
#### dataflow:v1b3 The following keys were deleted: - schemas.FlexTemplateRuntimeEnvironment.properties.maxNumWorkers (Total Keys: 2) The following keys were added: - schemas.FlexTemplateRuntimeEnvironment.properties.autoscalingAlgorithm.type (Total Keys: 1) - schemas.FlexTemplateRuntimeEnvironment.properties.dumpHeapOnOom.type (Total Keys: 1) - schemas.FlexTemplateRuntimeEnvironment.properties.saveHeapDumpsToGcsPath.type (Total Keys: 1)
1 parent 99e6f87 commit a8b3400

9 files changed

+100
-79
lines changed

docs/dyn/dataflow_v1b3.projects.jobs.html

Lines changed: 22 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -284,8 +284,8 @@ <h3>Method Details</h3>
284284
},
285285
&quot;id&quot;: &quot;A String&quot;, # The unique ID of this job. This field is set by the Cloud Dataflow service when the Job is created, and is immutable for the life of the job.
286286
&quot;jobMetadata&quot;: { # Metadata available primarily for filtering jobs. Will be included in the ListJob response and Job SUMMARY view. # This field is populated by the Dataflow service to support filtering jobs by the metadata values provided here. Populated for ListJobs and all GetJob views SUMMARY and higher.
287-
&quot;bigTableDetails&quot;: [ # Identification of a Cloud BigTable source used in the Dataflow job.
288-
{ # Metadata for a Cloud BigTable connector used by the job.
287+
&quot;bigTableDetails&quot;: [ # Identification of a Cloud Bigtable source used in the Dataflow job.
288+
{ # Metadata for a Cloud Bigtable connector used by the job.
289289
&quot;instanceId&quot;: &quot;A String&quot;, # InstanceId accessed in the connection.
290290
&quot;projectId&quot;: &quot;A String&quot;, # ProjectId accessed in the connection.
291291
&quot;tableId&quot;: &quot;A String&quot;, # TableId accessed in the connection.
@@ -310,7 +310,7 @@ <h3>Method Details</h3>
310310
&quot;filePattern&quot;: &quot;A String&quot;, # File Pattern used to access files by the connector.
311311
},
312312
],
313-
&quot;pubsubDetails&quot;: [ # Identification of a PubSub source used in the Dataflow job.
313+
&quot;pubsubDetails&quot;: [ # Identification of a Pub/Sub source used in the Dataflow job.
314314
{ # Metadata for a Pub/Sub connector used by the job.
315315
&quot;subscription&quot;: &quot;A String&quot;, # Subscription used in the connection.
316316
&quot;topic&quot;: &quot;A String&quot;, # Topic accessed in the connection.
@@ -613,8 +613,8 @@ <h3>Method Details</h3>
613613
},
614614
&quot;id&quot;: &quot;A String&quot;, # The unique ID of this job. This field is set by the Cloud Dataflow service when the Job is created, and is immutable for the life of the job.
615615
&quot;jobMetadata&quot;: { # Metadata available primarily for filtering jobs. Will be included in the ListJob response and Job SUMMARY view. # This field is populated by the Dataflow service to support filtering jobs by the metadata values provided here. Populated for ListJobs and all GetJob views SUMMARY and higher.
616-
&quot;bigTableDetails&quot;: [ # Identification of a Cloud BigTable source used in the Dataflow job.
617-
{ # Metadata for a Cloud BigTable connector used by the job.
616+
&quot;bigTableDetails&quot;: [ # Identification of a Cloud Bigtable source used in the Dataflow job.
617+
{ # Metadata for a Cloud Bigtable connector used by the job.
618618
&quot;instanceId&quot;: &quot;A String&quot;, # InstanceId accessed in the connection.
619619
&quot;projectId&quot;: &quot;A String&quot;, # ProjectId accessed in the connection.
620620
&quot;tableId&quot;: &quot;A String&quot;, # TableId accessed in the connection.
@@ -639,7 +639,7 @@ <h3>Method Details</h3>
639639
&quot;filePattern&quot;: &quot;A String&quot;, # File Pattern used to access files by the connector.
640640
},
641641
],
642-
&quot;pubsubDetails&quot;: [ # Identification of a PubSub source used in the Dataflow job.
642+
&quot;pubsubDetails&quot;: [ # Identification of a Pub/Sub source used in the Dataflow job.
643643
{ # Metadata for a Pub/Sub connector used by the job.
644644
&quot;subscription&quot;: &quot;A String&quot;, # Subscription used in the connection.
645645
&quot;topic&quot;: &quot;A String&quot;, # Topic accessed in the connection.
@@ -926,8 +926,8 @@ <h3>Method Details</h3>
926926
},
927927
&quot;id&quot;: &quot;A String&quot;, # The unique ID of this job. This field is set by the Cloud Dataflow service when the Job is created, and is immutable for the life of the job.
928928
&quot;jobMetadata&quot;: { # Metadata available primarily for filtering jobs. Will be included in the ListJob response and Job SUMMARY view. # This field is populated by the Dataflow service to support filtering jobs by the metadata values provided here. Populated for ListJobs and all GetJob views SUMMARY and higher.
929-
&quot;bigTableDetails&quot;: [ # Identification of a Cloud BigTable source used in the Dataflow job.
930-
{ # Metadata for a Cloud BigTable connector used by the job.
929+
&quot;bigTableDetails&quot;: [ # Identification of a Cloud Bigtable source used in the Dataflow job.
930+
{ # Metadata for a Cloud Bigtable connector used by the job.
931931
&quot;instanceId&quot;: &quot;A String&quot;, # InstanceId accessed in the connection.
932932
&quot;projectId&quot;: &quot;A String&quot;, # ProjectId accessed in the connection.
933933
&quot;tableId&quot;: &quot;A String&quot;, # TableId accessed in the connection.
@@ -952,7 +952,7 @@ <h3>Method Details</h3>
952952
&quot;filePattern&quot;: &quot;A String&quot;, # File Pattern used to access files by the connector.
953953
},
954954
],
955-
&quot;pubsubDetails&quot;: [ # Identification of a PubSub source used in the Dataflow job.
955+
&quot;pubsubDetails&quot;: [ # Identification of a Pub/Sub source used in the Dataflow job.
956956
{ # Metadata for a Pub/Sub connector used by the job.
957957
&quot;subscription&quot;: &quot;A String&quot;, # Subscription used in the connection.
958958
&quot;topic&quot;: &quot;A String&quot;, # Topic accessed in the connection.
@@ -1246,8 +1246,8 @@ <h3>Method Details</h3>
12461246
},
12471247
&quot;id&quot;: &quot;A String&quot;, # The unique ID of this job. This field is set by the Cloud Dataflow service when the Job is created, and is immutable for the life of the job.
12481248
&quot;jobMetadata&quot;: { # Metadata available primarily for filtering jobs. Will be included in the ListJob response and Job SUMMARY view. # This field is populated by the Dataflow service to support filtering jobs by the metadata values provided here. Populated for ListJobs and all GetJob views SUMMARY and higher.
1249-
&quot;bigTableDetails&quot;: [ # Identification of a Cloud BigTable source used in the Dataflow job.
1250-
{ # Metadata for a Cloud BigTable connector used by the job.
1249+
&quot;bigTableDetails&quot;: [ # Identification of a Cloud Bigtable source used in the Dataflow job.
1250+
{ # Metadata for a Cloud Bigtable connector used by the job.
12511251
&quot;instanceId&quot;: &quot;A String&quot;, # InstanceId accessed in the connection.
12521252
&quot;projectId&quot;: &quot;A String&quot;, # ProjectId accessed in the connection.
12531253
&quot;tableId&quot;: &quot;A String&quot;, # TableId accessed in the connection.
@@ -1272,7 +1272,7 @@ <h3>Method Details</h3>
12721272
&quot;filePattern&quot;: &quot;A String&quot;, # File Pattern used to access files by the connector.
12731273
},
12741274
],
1275-
&quot;pubsubDetails&quot;: [ # Identification of a PubSub source used in the Dataflow job.
1275+
&quot;pubsubDetails&quot;: [ # Identification of a Pub/Sub source used in the Dataflow job.
12761276
{ # Metadata for a Pub/Sub connector used by the job.
12771277
&quot;subscription&quot;: &quot;A String&quot;, # Subscription used in the connection.
12781278
&quot;topic&quot;: &quot;A String&quot;, # Topic accessed in the connection.
@@ -1623,8 +1623,8 @@ <h3>Method Details</h3>
16231623
},
16241624
&quot;id&quot;: &quot;A String&quot;, # The unique ID of this job. This field is set by the Cloud Dataflow service when the Job is created, and is immutable for the life of the job.
16251625
&quot;jobMetadata&quot;: { # Metadata available primarily for filtering jobs. Will be included in the ListJob response and Job SUMMARY view. # This field is populated by the Dataflow service to support filtering jobs by the metadata values provided here. Populated for ListJobs and all GetJob views SUMMARY and higher.
1626-
&quot;bigTableDetails&quot;: [ # Identification of a Cloud BigTable source used in the Dataflow job.
1627-
{ # Metadata for a Cloud BigTable connector used by the job.
1626+
&quot;bigTableDetails&quot;: [ # Identification of a Cloud Bigtable source used in the Dataflow job.
1627+
{ # Metadata for a Cloud Bigtable connector used by the job.
16281628
&quot;instanceId&quot;: &quot;A String&quot;, # InstanceId accessed in the connection.
16291629
&quot;projectId&quot;: &quot;A String&quot;, # ProjectId accessed in the connection.
16301630
&quot;tableId&quot;: &quot;A String&quot;, # TableId accessed in the connection.
@@ -1649,7 +1649,7 @@ <h3>Method Details</h3>
16491649
&quot;filePattern&quot;: &quot;A String&quot;, # File Pattern used to access files by the connector.
16501650
},
16511651
],
1652-
&quot;pubsubDetails&quot;: [ # Identification of a PubSub source used in the Dataflow job.
1652+
&quot;pubsubDetails&quot;: [ # Identification of a Pub/Sub source used in the Dataflow job.
16531653
{ # Metadata for a Pub/Sub connector used by the job.
16541654
&quot;subscription&quot;: &quot;A String&quot;, # Subscription used in the connection.
16551655
&quot;topic&quot;: &quot;A String&quot;, # Topic accessed in the connection.
@@ -1841,7 +1841,7 @@ <h3>Method Details</h3>
18411841
&quot;diskSizeBytes&quot;: &quot;A String&quot;, # The disk byte size of the snapshot. Only available for snapshots in READY state.
18421842
&quot;id&quot;: &quot;A String&quot;, # The unique ID of this snapshot.
18431843
&quot;projectId&quot;: &quot;A String&quot;, # The project this snapshot belongs to.
1844-
&quot;pubsubMetadata&quot;: [ # PubSub snapshot metadata.
1844+
&quot;pubsubMetadata&quot;: [ # Pub/Sub snapshot metadata.
18451845
{ # Represents a Pubsub snapshot.
18461846
&quot;expireTime&quot;: &quot;A String&quot;, # The expire time of the Pubsub snapshot.
18471847
&quot;snapshotName&quot;: &quot;A String&quot;, # The name of the Pubsub snapshot.
@@ -1993,8 +1993,8 @@ <h3>Method Details</h3>
19931993
},
19941994
&quot;id&quot;: &quot;A String&quot;, # The unique ID of this job. This field is set by the Cloud Dataflow service when the Job is created, and is immutable for the life of the job.
19951995
&quot;jobMetadata&quot;: { # Metadata available primarily for filtering jobs. Will be included in the ListJob response and Job SUMMARY view. # This field is populated by the Dataflow service to support filtering jobs by the metadata values provided here. Populated for ListJobs and all GetJob views SUMMARY and higher.
1996-
&quot;bigTableDetails&quot;: [ # Identification of a Cloud BigTable source used in the Dataflow job.
1997-
{ # Metadata for a Cloud BigTable connector used by the job.
1996+
&quot;bigTableDetails&quot;: [ # Identification of a Cloud Bigtable source used in the Dataflow job.
1997+
{ # Metadata for a Cloud Bigtable connector used by the job.
19981998
&quot;instanceId&quot;: &quot;A String&quot;, # InstanceId accessed in the connection.
19991999
&quot;projectId&quot;: &quot;A String&quot;, # ProjectId accessed in the connection.
20002000
&quot;tableId&quot;: &quot;A String&quot;, # TableId accessed in the connection.
@@ -2019,7 +2019,7 @@ <h3>Method Details</h3>
20192019
&quot;filePattern&quot;: &quot;A String&quot;, # File Pattern used to access files by the connector.
20202020
},
20212021
],
2022-
&quot;pubsubDetails&quot;: [ # Identification of a PubSub source used in the Dataflow job.
2022+
&quot;pubsubDetails&quot;: [ # Identification of a Pub/Sub source used in the Dataflow job.
20232023
{ # Metadata for a Pub/Sub connector used by the job.
20242024
&quot;subscription&quot;: &quot;A String&quot;, # Subscription used in the connection.
20252025
&quot;topic&quot;: &quot;A String&quot;, # Topic accessed in the connection.
@@ -2299,8 +2299,8 @@ <h3>Method Details</h3>
22992299
},
23002300
&quot;id&quot;: &quot;A String&quot;, # The unique ID of this job. This field is set by the Cloud Dataflow service when the Job is created, and is immutable for the life of the job.
23012301
&quot;jobMetadata&quot;: { # Metadata available primarily for filtering jobs. Will be included in the ListJob response and Job SUMMARY view. # This field is populated by the Dataflow service to support filtering jobs by the metadata values provided here. Populated for ListJobs and all GetJob views SUMMARY and higher.
2302-
&quot;bigTableDetails&quot;: [ # Identification of a Cloud BigTable source used in the Dataflow job.
2303-
{ # Metadata for a Cloud BigTable connector used by the job.
2302+
&quot;bigTableDetails&quot;: [ # Identification of a Cloud Bigtable source used in the Dataflow job.
2303+
{ # Metadata for a Cloud Bigtable connector used by the job.
23042304
&quot;instanceId&quot;: &quot;A String&quot;, # InstanceId accessed in the connection.
23052305
&quot;projectId&quot;: &quot;A String&quot;, # ProjectId accessed in the connection.
23062306
&quot;tableId&quot;: &quot;A String&quot;, # TableId accessed in the connection.
@@ -2325,7 +2325,7 @@ <h3>Method Details</h3>
23252325
&quot;filePattern&quot;: &quot;A String&quot;, # File Pattern used to access files by the connector.
23262326
},
23272327
],
2328-
&quot;pubsubDetails&quot;: [ # Identification of a PubSub source used in the Dataflow job.
2328+
&quot;pubsubDetails&quot;: [ # Identification of a Pub/Sub source used in the Dataflow job.
23292329
{ # Metadata for a Pub/Sub connector used by the job.
23302330
&quot;subscription&quot;: &quot;A String&quot;, # Subscription used in the connection.
23312331
&quot;topic&quot;: &quot;A String&quot;, # Topic accessed in the connection.

0 commit comments

Comments
 (0)