Skip to content

Commit 6930123

Browse files
feat(metastore): update the api
#### metastore:v1alpha The following keys were added: - schemas.DataplexConfig (Total Keys: 4) - schemas.HiveMetastoreConfig.properties.endpointProtocol.type (Total Keys: 1) - schemas.Lake (Total Keys: 3) - schemas.MetadataIntegration.properties.dataplexConfig.$ref (Total Keys: 1) #### metastore:v1beta The following keys were added: - schemas.DataplexConfig (Total Keys: 4) - schemas.HiveMetastoreConfig.properties.endpointProtocol.type (Total Keys: 1) - schemas.Lake (Total Keys: 3) - schemas.MetadataIntegration.properties.dataplexConfig.$ref (Total Keys: 1)
1 parent d07f46b commit 6930123

6 files changed

+200
-2
lines changed

docs/dyn/metastore_v1alpha.projects.locations.services.backups.html

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -135,6 +135,7 @@ <h3>Method Details</h3>
135135
&quot;configOverrides&quot;: { # A mapping of Hive metastore configuration key-value pairs to apply to the Hive metastore (configured in hive-site.xml). The mappings override system defaults (some keys cannot be overridden).
136136
&quot;a_key&quot;: &quot;A String&quot;,
137137
},
138+
&quot;endpointProtocol&quot;: &quot;A String&quot;, # The protocol to use for the metastore service endpoint. If unspecified, defaults to THRIFT.
138139
&quot;kerberosConfig&quot;: { # Configuration information for a Kerberos principal. # Information used to configure the Hive metastore service as a service principal in a Kerberos realm. To disable Kerberos, use the UpdateService method and specify this field&#x27;s path (hive_metastore_config.kerberos_config) in the request&#x27;s update_mask while omitting this field from the request&#x27;s service.
139140
&quot;keytab&quot;: { # A securely stored value. # A Kerberos keytab file that can be used to authenticate a service principal with a Kerberos Key Distribution Center (KDC).
140141
&quot;cloudSecret&quot;: &quot;A String&quot;, # The relative resource name of a Secret Manager secret version, in the following form:projects/{project_number}/secrets/{secret_id}/versions/{version_id}.
@@ -155,6 +156,13 @@ <h3>Method Details</h3>
155156
&quot;dataCatalogConfig&quot;: { # Specifies how metastore metadata should be integrated with the Data Catalog service. # The integration config for the Data Catalog service.
156157
&quot;enabled&quot;: True or False, # Defines whether the metastore metadata should be synced to Data Catalog. The default value is to disable syncing metastore metadata to Data Catalog.
157158
},
159+
&quot;dataplexConfig&quot;: { # Specifies how metastore metadata should be integrated with the Dataplex service. # The integration config for the Dataplex service.
160+
&quot;lakeResources&quot;: { # A reference to the Lake resources that this metastore service is attached to. The key is the lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}.
161+
&quot;a_key&quot;: { # Represents a Lake resource
162+
&quot;name&quot;: &quot;A String&quot;, # The Lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}
163+
},
164+
},
165+
},
158166
},
159167
&quot;metadataManagementActivity&quot;: { # The metadata management activities of the metastore service. # Output only. The metadata management activities of the metastore service.
160168
&quot;metadataExports&quot;: [ # Output only. The latest metadata exports of the metastore service.
@@ -290,6 +298,7 @@ <h3>Method Details</h3>
290298
&quot;configOverrides&quot;: { # A mapping of Hive metastore configuration key-value pairs to apply to the Hive metastore (configured in hive-site.xml). The mappings override system defaults (some keys cannot be overridden).
291299
&quot;a_key&quot;: &quot;A String&quot;,
292300
},
301+
&quot;endpointProtocol&quot;: &quot;A String&quot;, # The protocol to use for the metastore service endpoint. If unspecified, defaults to THRIFT.
293302
&quot;kerberosConfig&quot;: { # Configuration information for a Kerberos principal. # Information used to configure the Hive metastore service as a service principal in a Kerberos realm. To disable Kerberos, use the UpdateService method and specify this field&#x27;s path (hive_metastore_config.kerberos_config) in the request&#x27;s update_mask while omitting this field from the request&#x27;s service.
294303
&quot;keytab&quot;: { # A securely stored value. # A Kerberos keytab file that can be used to authenticate a service principal with a Kerberos Key Distribution Center (KDC).
295304
&quot;cloudSecret&quot;: &quot;A String&quot;, # The relative resource name of a Secret Manager secret version, in the following form:projects/{project_number}/secrets/{secret_id}/versions/{version_id}.
@@ -310,6 +319,13 @@ <h3>Method Details</h3>
310319
&quot;dataCatalogConfig&quot;: { # Specifies how metastore metadata should be integrated with the Data Catalog service. # The integration config for the Data Catalog service.
311320
&quot;enabled&quot;: True or False, # Defines whether the metastore metadata should be synced to Data Catalog. The default value is to disable syncing metastore metadata to Data Catalog.
312321
},
322+
&quot;dataplexConfig&quot;: { # Specifies how metastore metadata should be integrated with the Dataplex service. # The integration config for the Dataplex service.
323+
&quot;lakeResources&quot;: { # A reference to the Lake resources that this metastore service is attached to. The key is the lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}.
324+
&quot;a_key&quot;: { # Represents a Lake resource
325+
&quot;name&quot;: &quot;A String&quot;, # The Lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}
326+
},
327+
},
328+
},
313329
},
314330
&quot;metadataManagementActivity&quot;: { # The metadata management activities of the metastore service. # Output only. The metadata management activities of the metastore service.
315331
&quot;metadataExports&quot;: [ # Output only. The latest metadata exports of the metastore service.
@@ -433,6 +449,7 @@ <h3>Method Details</h3>
433449
&quot;configOverrides&quot;: { # A mapping of Hive metastore configuration key-value pairs to apply to the Hive metastore (configured in hive-site.xml). The mappings override system defaults (some keys cannot be overridden).
434450
&quot;a_key&quot;: &quot;A String&quot;,
435451
},
452+
&quot;endpointProtocol&quot;: &quot;A String&quot;, # The protocol to use for the metastore service endpoint. If unspecified, defaults to THRIFT.
436453
&quot;kerberosConfig&quot;: { # Configuration information for a Kerberos principal. # Information used to configure the Hive metastore service as a service principal in a Kerberos realm. To disable Kerberos, use the UpdateService method and specify this field&#x27;s path (hive_metastore_config.kerberos_config) in the request&#x27;s update_mask while omitting this field from the request&#x27;s service.
437454
&quot;keytab&quot;: { # A securely stored value. # A Kerberos keytab file that can be used to authenticate a service principal with a Kerberos Key Distribution Center (KDC).
438455
&quot;cloudSecret&quot;: &quot;A String&quot;, # The relative resource name of a Secret Manager secret version, in the following form:projects/{project_number}/secrets/{secret_id}/versions/{version_id}.
@@ -453,6 +470,13 @@ <h3>Method Details</h3>
453470
&quot;dataCatalogConfig&quot;: { # Specifies how metastore metadata should be integrated with the Data Catalog service. # The integration config for the Data Catalog service.
454471
&quot;enabled&quot;: True or False, # Defines whether the metastore metadata should be synced to Data Catalog. The default value is to disable syncing metastore metadata to Data Catalog.
455472
},
473+
&quot;dataplexConfig&quot;: { # Specifies how metastore metadata should be integrated with the Dataplex service. # The integration config for the Dataplex service.
474+
&quot;lakeResources&quot;: { # A reference to the Lake resources that this metastore service is attached to. The key is the lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}.
475+
&quot;a_key&quot;: { # Represents a Lake resource
476+
&quot;name&quot;: &quot;A String&quot;, # The Lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}
477+
},
478+
},
479+
},
456480
},
457481
&quot;metadataManagementActivity&quot;: { # The metadata management activities of the metastore service. # Output only. The metadata management activities of the metastore service.
458482
&quot;metadataExports&quot;: [ # Output only. The latest metadata exports of the metastore service.

docs/dyn/metastore_v1alpha.projects.locations.services.html

Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -151,6 +151,7 @@ <h3>Method Details</h3>
151151
&quot;configOverrides&quot;: { # A mapping of Hive metastore configuration key-value pairs to apply to the Hive metastore (configured in hive-site.xml). The mappings override system defaults (some keys cannot be overridden).
152152
&quot;a_key&quot;: &quot;A String&quot;,
153153
},
154+
&quot;endpointProtocol&quot;: &quot;A String&quot;, # The protocol to use for the metastore service endpoint. If unspecified, defaults to THRIFT.
154155
&quot;kerberosConfig&quot;: { # Configuration information for a Kerberos principal. # Information used to configure the Hive metastore service as a service principal in a Kerberos realm. To disable Kerberos, use the UpdateService method and specify this field&#x27;s path (hive_metastore_config.kerberos_config) in the request&#x27;s update_mask while omitting this field from the request&#x27;s service.
155156
&quot;keytab&quot;: { # A securely stored value. # A Kerberos keytab file that can be used to authenticate a service principal with a Kerberos Key Distribution Center (KDC).
156157
&quot;cloudSecret&quot;: &quot;A String&quot;, # The relative resource name of a Secret Manager secret version, in the following form:projects/{project_number}/secrets/{secret_id}/versions/{version_id}.
@@ -171,6 +172,13 @@ <h3>Method Details</h3>
171172
&quot;dataCatalogConfig&quot;: { # Specifies how metastore metadata should be integrated with the Data Catalog service. # The integration config for the Data Catalog service.
172173
&quot;enabled&quot;: True or False, # Defines whether the metastore metadata should be synced to Data Catalog. The default value is to disable syncing metastore metadata to Data Catalog.
173174
},
175+
&quot;dataplexConfig&quot;: { # Specifies how metastore metadata should be integrated with the Dataplex service. # The integration config for the Dataplex service.
176+
&quot;lakeResources&quot;: { # A reference to the Lake resources that this metastore service is attached to. The key is the lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}.
177+
&quot;a_key&quot;: { # Represents a Lake resource
178+
&quot;name&quot;: &quot;A String&quot;, # The Lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}
179+
},
180+
},
181+
},
174182
},
175183
&quot;metadataManagementActivity&quot;: { # The metadata management activities of the metastore service. # Output only. The metadata management activities of the metastore service.
176184
&quot;metadataExports&quot;: [ # Output only. The latest metadata exports of the metastore service.
@@ -340,6 +348,7 @@ <h3>Method Details</h3>
340348
&quot;configOverrides&quot;: { # A mapping of Hive metastore configuration key-value pairs to apply to the Hive metastore (configured in hive-site.xml). The mappings override system defaults (some keys cannot be overridden).
341349
&quot;a_key&quot;: &quot;A String&quot;,
342350
},
351+
&quot;endpointProtocol&quot;: &quot;A String&quot;, # The protocol to use for the metastore service endpoint. If unspecified, defaults to THRIFT.
343352
&quot;kerberosConfig&quot;: { # Configuration information for a Kerberos principal. # Information used to configure the Hive metastore service as a service principal in a Kerberos realm. To disable Kerberos, use the UpdateService method and specify this field&#x27;s path (hive_metastore_config.kerberos_config) in the request&#x27;s update_mask while omitting this field from the request&#x27;s service.
344353
&quot;keytab&quot;: { # A securely stored value. # A Kerberos keytab file that can be used to authenticate a service principal with a Kerberos Key Distribution Center (KDC).
345354
&quot;cloudSecret&quot;: &quot;A String&quot;, # The relative resource name of a Secret Manager secret version, in the following form:projects/{project_number}/secrets/{secret_id}/versions/{version_id}.
@@ -360,6 +369,13 @@ <h3>Method Details</h3>
360369
&quot;dataCatalogConfig&quot;: { # Specifies how metastore metadata should be integrated with the Data Catalog service. # The integration config for the Data Catalog service.
361370
&quot;enabled&quot;: True or False, # Defines whether the metastore metadata should be synced to Data Catalog. The default value is to disable syncing metastore metadata to Data Catalog.
362371
},
372+
&quot;dataplexConfig&quot;: { # Specifies how metastore metadata should be integrated with the Dataplex service. # The integration config for the Dataplex service.
373+
&quot;lakeResources&quot;: { # A reference to the Lake resources that this metastore service is attached to. The key is the lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}.
374+
&quot;a_key&quot;: { # Represents a Lake resource
375+
&quot;name&quot;: &quot;A String&quot;, # The Lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}
376+
},
377+
},
378+
},
363379
},
364380
&quot;metadataManagementActivity&quot;: { # The metadata management activities of the metastore service. # Output only. The metadata management activities of the metastore service.
365381
&quot;metadataExports&quot;: [ # Output only. The latest metadata exports of the metastore service.
@@ -474,6 +490,7 @@ <h3>Method Details</h3>
474490
&quot;configOverrides&quot;: { # A mapping of Hive metastore configuration key-value pairs to apply to the Hive metastore (configured in hive-site.xml). The mappings override system defaults (some keys cannot be overridden).
475491
&quot;a_key&quot;: &quot;A String&quot;,
476492
},
493+
&quot;endpointProtocol&quot;: &quot;A String&quot;, # The protocol to use for the metastore service endpoint. If unspecified, defaults to THRIFT.
477494
&quot;kerberosConfig&quot;: { # Configuration information for a Kerberos principal. # Information used to configure the Hive metastore service as a service principal in a Kerberos realm. To disable Kerberos, use the UpdateService method and specify this field&#x27;s path (hive_metastore_config.kerberos_config) in the request&#x27;s update_mask while omitting this field from the request&#x27;s service.
478495
&quot;keytab&quot;: { # A securely stored value. # A Kerberos keytab file that can be used to authenticate a service principal with a Kerberos Key Distribution Center (KDC).
479496
&quot;cloudSecret&quot;: &quot;A String&quot;, # The relative resource name of a Secret Manager secret version, in the following form:projects/{project_number}/secrets/{secret_id}/versions/{version_id}.
@@ -494,6 +511,13 @@ <h3>Method Details</h3>
494511
&quot;dataCatalogConfig&quot;: { # Specifies how metastore metadata should be integrated with the Data Catalog service. # The integration config for the Data Catalog service.
495512
&quot;enabled&quot;: True or False, # Defines whether the metastore metadata should be synced to Data Catalog. The default value is to disable syncing metastore metadata to Data Catalog.
496513
},
514+
&quot;dataplexConfig&quot;: { # Specifies how metastore metadata should be integrated with the Dataplex service. # The integration config for the Dataplex service.
515+
&quot;lakeResources&quot;: { # A reference to the Lake resources that this metastore service is attached to. The key is the lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}.
516+
&quot;a_key&quot;: { # Represents a Lake resource
517+
&quot;name&quot;: &quot;A String&quot;, # The Lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}
518+
},
519+
},
520+
},
497521
},
498522
&quot;metadataManagementActivity&quot;: { # The metadata management activities of the metastore service. # Output only. The metadata management activities of the metastore service.
499523
&quot;metadataExports&quot;: [ # Output only. The latest metadata exports of the metastore service.
@@ -567,6 +591,7 @@ <h3>Method Details</h3>
567591
&quot;configOverrides&quot;: { # A mapping of Hive metastore configuration key-value pairs to apply to the Hive metastore (configured in hive-site.xml). The mappings override system defaults (some keys cannot be overridden).
568592
&quot;a_key&quot;: &quot;A String&quot;,
569593
},
594+
&quot;endpointProtocol&quot;: &quot;A String&quot;, # The protocol to use for the metastore service endpoint. If unspecified, defaults to THRIFT.
570595
&quot;kerberosConfig&quot;: { # Configuration information for a Kerberos principal. # Information used to configure the Hive metastore service as a service principal in a Kerberos realm. To disable Kerberos, use the UpdateService method and specify this field&#x27;s path (hive_metastore_config.kerberos_config) in the request&#x27;s update_mask while omitting this field from the request&#x27;s service.
571596
&quot;keytab&quot;: { # A securely stored value. # A Kerberos keytab file that can be used to authenticate a service principal with a Kerberos Key Distribution Center (KDC).
572597
&quot;cloudSecret&quot;: &quot;A String&quot;, # The relative resource name of a Secret Manager secret version, in the following form:projects/{project_number}/secrets/{secret_id}/versions/{version_id}.
@@ -587,6 +612,13 @@ <h3>Method Details</h3>
587612
&quot;dataCatalogConfig&quot;: { # Specifies how metastore metadata should be integrated with the Data Catalog service. # The integration config for the Data Catalog service.
588613
&quot;enabled&quot;: True or False, # Defines whether the metastore metadata should be synced to Data Catalog. The default value is to disable syncing metastore metadata to Data Catalog.
589614
},
615+
&quot;dataplexConfig&quot;: { # Specifies how metastore metadata should be integrated with the Dataplex service. # The integration config for the Dataplex service.
616+
&quot;lakeResources&quot;: { # A reference to the Lake resources that this metastore service is attached to. The key is the lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}.
617+
&quot;a_key&quot;: { # Represents a Lake resource
618+
&quot;name&quot;: &quot;A String&quot;, # The Lake resource name. Example: projects/{project_number}/locations/{location_id}/lakes/{lake_id}
619+
},
620+
},
621+
},
590622
},
591623
&quot;metadataManagementActivity&quot;: { # The metadata management activities of the metastore service. # Output only. The metadata management activities of the metastore service.
592624
&quot;metadataExports&quot;: [ # Output only. The latest metadata exports of the metastore service.

0 commit comments

Comments
 (0)