Skip to content

Commit 02db555

Browse files
begoldsmamarzavery
begoldsm
authored and
amarzavery
committed
Update ADL catalog (#346)
* Remove requirement on subscriptionId These clients don't need a subscriptionId. * Need to make contents required since this is a PUT. Will add extensions that make it optional in C# and zero it out to an empty stream. * update documentation to reflect param required * undo this temp change Issue: Azure/autorest#884 is tracking support for this being an optional param properly and not resulting in a null reference. So I will keep this spec as is. * Change this name to be more descriptive. * does not need to be modeled as a string. Makes this more obvious to end users and easier to understand. * fix all enums to be enums. * Add new API version for job This API version changes the format for dates and timespan objects to be ISO compliant. * missed version change here as well. * temp commit to remove the required flag We need a way to have template parameters not be required when they are in the host. I will work with Amar for this next week. * Revert "temp commit to remove the required flag" This reverts commit be8b7bf. * Add missing enum value * Missed one. * Add in new functionality Switch over to MSLISTSTATUS which gives more flexibility for listing files/folders. * Work around for issue: 903 explicitly calling out our chunked transfer APIs until issue: Azure/autorest#903 is resolved. * addressed comments from Amar. * fix descriptions and add partition APIs * Add missing method to delete all secrets in db In hyak, we could do this by simply excluding the parameter. That is not swagger compliant, so we need a separate entry. * temporarily remove partition list for current ship. this will be in the next snap. * Add diagnostics to USqlJobProperties. This was missing during the port from Hyak. * Missing enum value. * two more missing enums. * Put partitions back in for next release. * Test out composites. * add the log folder and logFilePattern to the sdk This is for all jobs going forward. Fix the readOnly properties to be bool instead of strings (makes tests happy). * Remove composite specs since they don't work * Error json fixes InnerError fixed to innerError Adding the WebHDFS definition for ErrorResponses to the filesystem. * bad syntax is bad. * missed a boolean switch for readOnly,. * definition -> definitions * Change the name to be more descriptive * Following feedback from the slack forum This should help reduce the levels of nesting and also fixes some feedback in the job swagger. * Add discriminators for webhdfs * Further flatten and rename Removing WebHdfsError and renaming "RemoteException" * Rename to Adls * nested exception discriminator * update the required piece. * try not indexing * move it down to see if this fixes it. * Try nesting again. * Trying a work around. Add a placeholder property at the root level which should get properly picked up. * Update to the work around Slight change to the stub property. * Work around didn't work, going back to what did. * Removed the unneccessary nesting. * Add the accesscontrolexception * remove extra next link stuff I thought I had removed this previously. removing it again, since it should no longer be used. * Remove currently unsupported API * Adding missing x-ms-odata tags in catalog * switch to GET for this call per the FE team This API supports both a GET and a POST, with the POST planning on being deprecated before we GA, so we are switching the SDK now in preparation. * Add partition properties parentName createDate * missed the # * Removing get/set from descriptions latest generation tool automatically adds it. * Fixed to not remove "Gets " from method descript * Add the get back to globals. * Catalog item updates Add distributionInfo to tables Add a new type called USqlTableType * Fix URL based on feedback should be tabletypes instead of tables
1 parent 0130f19 commit 02db555

File tree

1 file changed

+183
-0
lines changed
  • arm-datalake-analytics/catalog/2015-10-01-preview/swagger

1 file changed

+183
-0
lines changed

‎arm-datalake-analytics/catalog/2015-10-01-preview/swagger/catalog.json

Lines changed: 183 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -726,6 +726,140 @@
726726
"x-ms-odata": "#/definitions/USqlTable"
727727
}
728728
},
729+
"/catalog/usql/databases/{databaseName}/schemas/{schemaName}/tabletypes/{tableTypeName}": {
730+
"get": {
731+
"tags": [
732+
"Catalog"
733+
],
734+
"operationId": "Catalog_GetTableType",
735+
"description": "Retrieves the specified table type from the Data Lake Analytics catalog.",
736+
"parameters": [
737+
{
738+
"name": "databaseName",
739+
"in": "path",
740+
"required": true,
741+
"type": "string",
742+
"description": "The name of the database containing the table type."
743+
},
744+
{
745+
"name": "schemaName",
746+
"in": "path",
747+
"required": true,
748+
"type": "string",
749+
"description": "The name of the schema containing the table type."
750+
},
751+
{
752+
"name": "tableTypeName",
753+
"in": "path",
754+
"required": true,
755+
"type": "string",
756+
"description": "The name of the table type to retrieve."
757+
},
758+
{
759+
"$ref": "#/parameters/ApiVersionParameter"
760+
}
761+
],
762+
"responses": {
763+
"200": {
764+
"description": "",
765+
"schema": {
766+
"$ref": "#/definitions/USqlTableType"
767+
}
768+
}
769+
}
770+
}
771+
},
772+
"/catalog/usql/databases/{databaseName}/schemas/{schemaName}/tabletypes": {
773+
"get": {
774+
"tags": [
775+
"Catalog"
776+
],
777+
"operationId": "Catalog_ListTableTypes",
778+
"description": "Retrieves the list of table types from the Data Lake Analytics catalog.",
779+
"parameters": [
780+
{
781+
"name": "databaseName",
782+
"in": "path",
783+
"required": true,
784+
"type": "string",
785+
"description": "The name of the database containing the table types."
786+
},
787+
{
788+
"name": "schemaName",
789+
"in": "path",
790+
"required": true,
791+
"type": "string",
792+
"description": "The name of the schema containing the table types."
793+
},
794+
{
795+
"name": "$filter",
796+
"in": "query",
797+
"required": false,
798+
"type": "string",
799+
"description": "OData filter. Optional."
800+
},
801+
{
802+
"name": "$top",
803+
"in": "query",
804+
"required": false,
805+
"type": "integer",
806+
"format": "int32",
807+
"description": "The number of items to return. Optional."
808+
},
809+
{
810+
"name": "$skip",
811+
"in": "query",
812+
"required": false,
813+
"type": "integer",
814+
"format": "int32",
815+
"description": "The number of items to skip over before returning elements. Optional."
816+
},
817+
{
818+
"name": "$expand",
819+
"in": "query",
820+
"required": false,
821+
"type": "string",
822+
"description": "OData expansion. Expand related resources in line with the retrieved resources, e.g. Categories?$expand=Products would expand Product data in line with each Category entry. Optional."
823+
},
824+
{
825+
"name": "$select",
826+
"in": "query",
827+
"required": false,
828+
"type": "string",
829+
"description": "OData Select statement. Limits the properties on each entry to just those requested, e.g. Categories?$select=CategoryName,Description. Optional."
830+
},
831+
{
832+
"name": "$orderby",
833+
"in": "query",
834+
"required": false,
835+
"type": "string",
836+
"description": "OrderBy clause. One or more comma-separated expressions with an optional \"asc\" (the default) or \"desc\" depending on the order you'd like the values sorted, e.g. Categories?$orderby=CategoryName desc. Optional."
837+
},
838+
{
839+
"name": "$count",
840+
"in": "query",
841+
"required": false,
842+
"type": "boolean",
843+
"description": "The Boolean value of true or false to request a count of the matching resources included with the resources in the response, e.g. Categories?$count=true. Optional."
844+
},
845+
{
846+
"$ref": "#/parameters/ApiVersionParameter"
847+
}
848+
],
849+
"responses": {
850+
"200": {
851+
"description": "",
852+
"schema": {
853+
"$ref": "#/definitions/USqlTableTypeList"
854+
}
855+
}
856+
},
857+
"x-ms-pageable": {
858+
"nextLinkName": "nextLink"
859+
},
860+
"x-ms-odata": "#/definitions/USqlTableType"
861+
}
862+
},
729863
"/catalog/usql/databases/{databaseName}/schemas/{schemaName}/views/{viewName}": {
730864
"get": {
731865
"tags": [
@@ -2079,6 +2213,19 @@
20792213
},
20802214
"description": "A Data Lake Analytics catalog external table item."
20812215
},
2216+
"TypeFieldInfo": {
2217+
"properties": {
2218+
"name": {
2219+
"type": "string",
2220+
"description": "the name of the field associated with this type."
2221+
},
2222+
"type": {
2223+
"type": "string",
2224+
"description": "the type of the field."
2225+
}
2226+
},
2227+
"description": "A Data Lake Analytics catalog type field information item."
2228+
},
20822229
"USqlTable": {
20832230
"allOf": [
20842231
{
@@ -2123,6 +2270,10 @@
21232270
"externalTable": {
21242271
"$ref": "#/definitions/ExternalTable",
21252272
"description": "the external table associated with the table."
2273+
},
2274+
"distributionInfo": {
2275+
"$ref": "#/definitions/USqlDistributionInfo",
2276+
"description": "the distributions info of the table"
21262277
}
21272278
},
21282279
"description": "A Data Lake Analytics catalog U-SQL table item."
@@ -2145,6 +2296,38 @@
21452296
},
21462297
"description": "A Data Lake Analytics catalog U-SQL table item list."
21472298
},
2299+
"USqlTableType": {
2300+
"allOf": [
2301+
{
2302+
"$ref": "#/definitions/USqlType"
2303+
}
2304+
],
2305+
"properties": {
2306+
"columns": {
2307+
"$ref": "#/definitions/TypeFieldInfo",
2308+
"description": "the type field information associated with this table type."
2309+
}
2310+
},
2311+
"description": "A Data Lake Analytics catalog U-SQL table type item."
2312+
},
2313+
"USqlTableTypeList": {
2314+
"allOf": [
2315+
{
2316+
"$ref": "#/definitions/CatalogItemList"
2317+
}
2318+
],
2319+
"properties": {
2320+
"value": {
2321+
"type": "array",
2322+
"readOnly": true,
2323+
"items": {
2324+
"$ref": "#/definitions/USqlTableType"
2325+
},
2326+
"description": "the list of table types in the database and schema combination"
2327+
}
2328+
},
2329+
"description": "A Data Lake Analytics catalog U-SQL table type item list."
2330+
},
21482331
"USqlView": {
21492332
"allOf": [
21502333
{

0 commit comments

Comments
 (0)