Skip to content

Commit f0f157e

Browse files
feat(aiplatform): update the api
#### aiplatform:v1 The following keys were deleted: - schemas.GoogleCloudAiplatformV1MachineSpec.properties.multihostGpuNodeCount (Total Keys: 2) The following keys were added: - schemas.CloudAiLargeModelsVisionGenerateVideoResponse.properties.videos (Total Keys: 2) - schemas.CloudAiLargeModelsVisionGenerateVideoResponseVideo (Total Keys: 5) - schemas.CloudAiLargeModelsVisionVideo.properties.text.type (Total Keys: 1) - schemas.GoogleCloudAiplatformV1EnterpriseWebSearch (Total Keys: 2) - schemas.GoogleCloudAiplatformV1GenerateContentResponseUsageMetadata.properties.toolUsePromptTokenCount (Total Keys: 3) - schemas.GoogleCloudAiplatformV1GenerateContentResponseUsageMetadata.properties.toolUsePromptTokensDetails (Total Keys: 3) - schemas.GoogleCloudAiplatformV1GenerateVideoResponse (Total Keys: 16) - schemas.GoogleCloudAiplatformV1ReasoningEngineSpec.properties.deploymentSpec.$ref (Total Keys: 1) - schemas.GoogleCloudAiplatformV1ReasoningEngineSpecDeploymentSpec (Total Keys: 6) - schemas.GoogleCloudAiplatformV1SecretEnvVar (Total Keys: 4) - schemas.GoogleCloudAiplatformV1SecretRef (Total Keys: 4) - schemas.GoogleCloudAiplatformV1Tool.properties.enterpriseWebSearch.$ref (Total Keys: 1) #### aiplatform:v1beta1 The following keys were added: - schemas.CloudAiLargeModelsVisionGenerateVideoResponse.properties.videos (Total Keys: 2) - schemas.CloudAiLargeModelsVisionGenerateVideoResponseVideo (Total Keys: 5) - schemas.CloudAiLargeModelsVisionVideo.properties.text.type (Total Keys: 1) - schemas.GoogleCloudAiplatformV1beta1DeployRequest (Total Keys: 22) - schemas.GoogleCloudAiplatformV1beta1EnterpriseWebSearch (Total Keys: 2) - schemas.GoogleCloudAiplatformV1beta1GenerateContentResponseUsageMetadata.properties.toolUsePromptTokenCount (Total Keys: 3) - schemas.GoogleCloudAiplatformV1beta1GenerateContentResponseUsageMetadata.properties.toolUsePromptTokensDetails (Total Keys: 3) - schemas.GoogleCloudAiplatformV1beta1GenerateVideoResponse.properties.generatedSamples.deprecated (Total Keys: 1) - schemas.GoogleCloudAiplatformV1beta1GenerateVideoResponse.properties.videos (Total Keys: 2) - schemas.GoogleCloudAiplatformV1beta1GenerateVideoResponseVideo (Total Keys: 5) - schemas.GoogleCloudAiplatformV1beta1MachineSpec.properties.multihostGpuNodeCount (Total Keys: 2) - schemas.GoogleCloudAiplatformV1beta1ReasoningEngineSpec.properties.deploymentSpec.$ref (Total Keys: 1) - schemas.GoogleCloudAiplatformV1beta1ReasoningEngineSpecDeploymentSpec (Total Keys: 6) - schemas.GoogleCloudAiplatformV1beta1SecretEnvVar (Total Keys: 4) - schemas.GoogleCloudAiplatformV1beta1SecretRef (Total Keys: 4) - schemas.GoogleCloudAiplatformV1beta1Tool.properties.enterpriseWebSearch.$ref (Total Keys: 1)
1 parent df40ac6 commit f0f157e

File tree

39 files changed

+1070
-347
lines changed

39 files changed

+1070
-347
lines changed

docs/dyn/aiplatform_v1.endpoints.html

Lines changed: 31 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -353,7 +353,9 @@ <h3>Method Details</h3>
353353
},
354354
&quot;tools&quot;: [ # Optional. A list of `Tools` the model may use to generate the next response. A `Tool` is a piece of code that enables the system to interact with external systems to perform an action, or set of actions, outside of knowledge and scope of the model.
355355
{ # Tool details that the model may use to generate response. A `Tool` is a piece of code that enables the system to interact with external systems to perform an action, or set of actions, outside of knowledge and scope of the model. A Tool object should contain exactly one type of Tool (e.g FunctionDeclaration, Retrieval or GoogleSearchRetrieval).
356-
&quot;codeExecution&quot;: { # Tool that executes code generated by the model, and automatically returns the result to the model. See also [ExecutableCode]and [CodeExecutionResult] which are input and output to this tool. # Optional. CodeExecution tool type. Enables the model to execute code as part of generation. This field is only used by the Gemini Developer API services.
356+
&quot;codeExecution&quot;: { # Tool that executes code generated by the model, and automatically returns the result to the model. See also [ExecutableCode]and [CodeExecutionResult] which are input and output to this tool. # Optional. CodeExecution tool type. Enables the model to execute code as part of generation.
357+
},
358+
&quot;enterpriseWebSearch&quot;: { # Tool to search public web data, powered by Vertex AI Search and Sec4 compliance. # Optional. Tool to support searching public web data, powered by Vertex AI Search and Sec4 compliance.
357359
},
358360
&quot;functionDeclarations&quot;: [ # Optional. Function tool type. One or more function declarations to be passed to the model along with the current user query. Model may decide to call a subset of these functions by populating FunctionCall in the response. User should provide a FunctionResponse for each function call in the next turn. Based on the function responses, Model will generate the final response back to the user. Maximum 128 function declarations can be provided.
359361
{ # Structured representation of a function declaration as defined by the [OpenAPI 3.0 specification](https://spec.openapis.org/oas/v3.0.3). Included in this declaration are the function name, description, parameters and response type. This FunctionDeclaration is a representation of a block of code that can be used as a `Tool` by the model and executed by the client.
@@ -439,8 +441,8 @@ <h3>Method Details</h3>
439441
},
440442
&quot;retrieval&quot;: { # Defines a retrieval tool that model can call to access external knowledge. # Optional. Retrieval tool type. System will always execute the provided retrieval tool(s) to get external knowledge to answer the prompt. Retrieval results are presented to the model for generation.
441443
&quot;disableAttribution&quot;: True or False, # Optional. Deprecated. This option is no longer supported.
442-
&quot;vertexAiSearch&quot;: { # Retrieve from Vertex AI Search datastore for grounding. See https://cloud.google.com/products/agent-builder # Set to use data source powered by Vertex AI Search.
443-
&quot;datastore&quot;: &quot;A String&quot;, # Required. Fully-qualified Vertex AI Search data store resource ID. Format: `projects/{project}/locations/{location}/collections/{collection}/dataStores/{dataStore}`
444+
&quot;vertexAiSearch&quot;: { # Retrieve from Vertex AI Search datastore or engine for grounding. datastore and engine are mutually exclusive. See https://cloud.google.com/products/agent-builder # Set to use data source powered by Vertex AI Search.
445+
&quot;datastore&quot;: &quot;A String&quot;, # Optional. Fully-qualified Vertex AI Search data store resource ID. Format: `projects/{project}/locations/{location}/collections/{collection}/dataStores/{dataStore}`
444446
},
445447
&quot;vertexRagStore&quot;: { # Retrieve from Vertex RAG Store for grounding. # Set to use data source powered by Vertex RAG store. User data is uploaded via the VertexRagDataService.
446448
&quot;ragResources&quot;: [ # Optional. The representation of the rag source. It can be used to specify corpus only or ragfiles. Currently only support one corpus or multiple files from one corpus. In the future we may open up multiple corpora support.
@@ -681,7 +683,9 @@ <h3>Method Details</h3>
681683
},
682684
&quot;tools&quot;: [ # Optional. A list of `Tools` the model may use to generate the next response. A `Tool` is a piece of code that enables the system to interact with external systems to perform an action, or set of actions, outside of knowledge and scope of the model.
683685
{ # Tool details that the model may use to generate response. A `Tool` is a piece of code that enables the system to interact with external systems to perform an action, or set of actions, outside of knowledge and scope of the model. A Tool object should contain exactly one type of Tool (e.g FunctionDeclaration, Retrieval or GoogleSearchRetrieval).
684-
&quot;codeExecution&quot;: { # Tool that executes code generated by the model, and automatically returns the result to the model. See also [ExecutableCode]and [CodeExecutionResult] which are input and output to this tool. # Optional. CodeExecution tool type. Enables the model to execute code as part of generation. This field is only used by the Gemini Developer API services.
686+
&quot;codeExecution&quot;: { # Tool that executes code generated by the model, and automatically returns the result to the model. See also [ExecutableCode]and [CodeExecutionResult] which are input and output to this tool. # Optional. CodeExecution tool type. Enables the model to execute code as part of generation.
687+
},
688+
&quot;enterpriseWebSearch&quot;: { # Tool to search public web data, powered by Vertex AI Search and Sec4 compliance. # Optional. Tool to support searching public web data, powered by Vertex AI Search and Sec4 compliance.
685689
},
686690
&quot;functionDeclarations&quot;: [ # Optional. Function tool type. One or more function declarations to be passed to the model along with the current user query. Model may decide to call a subset of these functions by populating FunctionCall in the response. User should provide a FunctionResponse for each function call in the next turn. Based on the function responses, Model will generate the final response back to the user. Maximum 128 function declarations can be provided.
687691
{ # Structured representation of a function declaration as defined by the [OpenAPI 3.0 specification](https://spec.openapis.org/oas/v3.0.3). Included in this declaration are the function name, description, parameters and response type. This FunctionDeclaration is a representation of a block of code that can be used as a `Tool` by the model and executed by the client.
@@ -767,8 +771,8 @@ <h3>Method Details</h3>
767771
},
768772
&quot;retrieval&quot;: { # Defines a retrieval tool that model can call to access external knowledge. # Optional. Retrieval tool type. System will always execute the provided retrieval tool(s) to get external knowledge to answer the prompt. Retrieval results are presented to the model for generation.
769773
&quot;disableAttribution&quot;: True or False, # Optional. Deprecated. This option is no longer supported.
770-
&quot;vertexAiSearch&quot;: { # Retrieve from Vertex AI Search datastore for grounding. See https://cloud.google.com/products/agent-builder # Set to use data source powered by Vertex AI Search.
771-
&quot;datastore&quot;: &quot;A String&quot;, # Required. Fully-qualified Vertex AI Search data store resource ID. Format: `projects/{project}/locations/{location}/collections/{collection}/dataStores/{dataStore}`
774+
&quot;vertexAiSearch&quot;: { # Retrieve from Vertex AI Search datastore or engine for grounding. datastore and engine are mutually exclusive. See https://cloud.google.com/products/agent-builder # Set to use data source powered by Vertex AI Search.
775+
&quot;datastore&quot;: &quot;A String&quot;, # Optional. Fully-qualified Vertex AI Search data store resource ID. Format: `projects/{project}/locations/{location}/collections/{collection}/dataStores/{dataStore}`
772776
},
773777
&quot;vertexRagStore&quot;: { # Retrieve from Vertex RAG Store for grounding. # Set to use data source powered by Vertex RAG store. User data is uploaded via the VertexRagDataService.
774778
&quot;ragResources&quot;: [ # Optional. The representation of the rag source. It can be used to specify corpus only or ragfiles. Currently only support one corpus or multiple files from one corpus. In the future we may open up multiple corpora support.
@@ -980,7 +984,14 @@ <h3>Method Details</h3>
980984
&quot;tokenCount&quot;: 42, # Number of tokens.
981985
},
982986
],
983-
&quot;totalTokenCount&quot;: 42, # Total token count for prompt and response candidates.
987+
&quot;toolUsePromptTokenCount&quot;: 42, # Output only. Number of tokens present in tool-use prompt(s).
988+
&quot;toolUsePromptTokensDetails&quot;: [ # Output only. List of modalities that were processed for tool-use request inputs.
989+
{ # Represents token counting info for a single modality.
990+
&quot;modality&quot;: &quot;A String&quot;, # The modality associated with this token count.
991+
&quot;tokenCount&quot;: 42, # Number of tokens.
992+
},
993+
],
994+
&quot;totalTokenCount&quot;: 42, # Total token count for prompt, response candidates, and tool-use prompts (if present).
984995
},
985996
}</pre>
986997
</div>
@@ -1215,7 +1226,9 @@ <h3>Method Details</h3>
12151226
},
12161227
&quot;tools&quot;: [ # Optional. A list of `Tools` the model may use to generate the next response. A `Tool` is a piece of code that enables the system to interact with external systems to perform an action, or set of actions, outside of knowledge and scope of the model.
12171228
{ # Tool details that the model may use to generate response. A `Tool` is a piece of code that enables the system to interact with external systems to perform an action, or set of actions, outside of knowledge and scope of the model. A Tool object should contain exactly one type of Tool (e.g FunctionDeclaration, Retrieval or GoogleSearchRetrieval).
1218-
&quot;codeExecution&quot;: { # Tool that executes code generated by the model, and automatically returns the result to the model. See also [ExecutableCode]and [CodeExecutionResult] which are input and output to this tool. # Optional. CodeExecution tool type. Enables the model to execute code as part of generation. This field is only used by the Gemini Developer API services.
1229+
&quot;codeExecution&quot;: { # Tool that executes code generated by the model, and automatically returns the result to the model. See also [ExecutableCode]and [CodeExecutionResult] which are input and output to this tool. # Optional. CodeExecution tool type. Enables the model to execute code as part of generation.
1230+
},
1231+
&quot;enterpriseWebSearch&quot;: { # Tool to search public web data, powered by Vertex AI Search and Sec4 compliance. # Optional. Tool to support searching public web data, powered by Vertex AI Search and Sec4 compliance.
12191232
},
12201233
&quot;functionDeclarations&quot;: [ # Optional. Function tool type. One or more function declarations to be passed to the model along with the current user query. Model may decide to call a subset of these functions by populating FunctionCall in the response. User should provide a FunctionResponse for each function call in the next turn. Based on the function responses, Model will generate the final response back to the user. Maximum 128 function declarations can be provided.
12211234
{ # Structured representation of a function declaration as defined by the [OpenAPI 3.0 specification](https://spec.openapis.org/oas/v3.0.3). Included in this declaration are the function name, description, parameters and response type. This FunctionDeclaration is a representation of a block of code that can be used as a `Tool` by the model and executed by the client.
@@ -1301,8 +1314,8 @@ <h3>Method Details</h3>
13011314
},
13021315
&quot;retrieval&quot;: { # Defines a retrieval tool that model can call to access external knowledge. # Optional. Retrieval tool type. System will always execute the provided retrieval tool(s) to get external knowledge to answer the prompt. Retrieval results are presented to the model for generation.
13031316
&quot;disableAttribution&quot;: True or False, # Optional. Deprecated. This option is no longer supported.
1304-
&quot;vertexAiSearch&quot;: { # Retrieve from Vertex AI Search datastore for grounding. See https://cloud.google.com/products/agent-builder # Set to use data source powered by Vertex AI Search.
1305-
&quot;datastore&quot;: &quot;A String&quot;, # Required. Fully-qualified Vertex AI Search data store resource ID. Format: `projects/{project}/locations/{location}/collections/{collection}/dataStores/{dataStore}`
1317+
&quot;vertexAiSearch&quot;: { # Retrieve from Vertex AI Search datastore or engine for grounding. datastore and engine are mutually exclusive. See https://cloud.google.com/products/agent-builder # Set to use data source powered by Vertex AI Search.
1318+
&quot;datastore&quot;: &quot;A String&quot;, # Optional. Fully-qualified Vertex AI Search data store resource ID. Format: `projects/{project}/locations/{location}/collections/{collection}/dataStores/{dataStore}`
13061319
},
13071320
&quot;vertexRagStore&quot;: { # Retrieve from Vertex RAG Store for grounding. # Set to use data source powered by Vertex RAG store. User data is uploaded via the VertexRagDataService.
13081321
&quot;ragResources&quot;: [ # Optional. The representation of the rag source. It can be used to specify corpus only or ragfiles. Currently only support one corpus or multiple files from one corpus. In the future we may open up multiple corpora support.
@@ -1514,7 +1527,14 @@ <h3>Method Details</h3>
15141527
&quot;tokenCount&quot;: 42, # Number of tokens.
15151528
},
15161529
],
1517-
&quot;totalTokenCount&quot;: 42, # Total token count for prompt and response candidates.
1530+
&quot;toolUsePromptTokenCount&quot;: 42, # Output only. Number of tokens present in tool-use prompt(s).
1531+
&quot;toolUsePromptTokensDetails&quot;: [ # Output only. List of modalities that were processed for tool-use request inputs.
1532+
{ # Represents token counting info for a single modality.
1533+
&quot;modality&quot;: &quot;A String&quot;, # The modality associated with this token count.
1534+
&quot;tokenCount&quot;: 42, # Number of tokens.
1535+
},
1536+
],
1537+
&quot;totalTokenCount&quot;: 42, # Total token count for prompt, response candidates, and tool-use prompts (if present).
15181538
},
15191539
}</pre>
15201540
</div>

0 commit comments

Comments
 (0)