Skip to content

Commit f3fcfab

Browse files
author
AWS
committed
Amazon Appflow Update: Adding the following features/changes: Parquet output that preserves typing from the source connector, Failed executions threshold before deactivation for scheduled flows, increasing max size of access and refresh token from 2048 to 4096
1 parent ec76b2f commit f3fcfab

File tree

2 files changed

+29
-8
lines changed

2 files changed

+29
-8
lines changed
Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
{
2+
"type": "feature",
3+
"category": "Amazon Appflow",
4+
"contributor": "",
5+
"description": "Adding the following features/changes: Parquet output that preserves typing from the source connector, Failed executions threshold before deactivation for scheduled flows, increasing max size of access and refresh token from 2048 to 4096"
6+
}

services/appflow/src/main/resources/codegen-resources/service-2.json

Lines changed: 23 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,7 @@
2727
{"shape":"ConnectorAuthenticationException"},
2828
{"shape":"InternalServerException"}
2929
],
30-
"documentation":"<p> Creates a new connector profile associated with your Amazon Web Services account. There is a soft quota of 100 connector profiles per Amazon Web Services account. If you need more connector profiles than this quota allows, you can submit a request to the Amazon AppFlow team through the Amazon AppFlow support channel. </p>"
30+
"documentation":"<p> Creates a new connector profile associated with your Amazon Web Services account. There is a soft quota of 100 connector profiles per Amazon Web Services account. If you need more connector profiles than this quota allows, you can submit a request to the Amazon AppFlow team through the Amazon AppFlow support channel. In each connector profile that you create, you can provide the credentials and properties for only one connector.</p>"
3131
},
3232
"CreateFlow":{
3333
"name":"CreateFlow",
@@ -108,7 +108,7 @@
108108
{"shape":"ConnectorServerException"},
109109
{"shape":"InternalServerException"}
110110
],
111-
"documentation":"<p> Provides details regarding the entity used with the connector, with a description of the data model for each entity. </p>"
111+
"documentation":"<p> Provides details regarding the entity used with the connector, with a description of the data model for each field in that entity. </p>"
112112
},
113113
"DescribeConnectorProfiles":{
114114
"name":"DescribeConnectorProfiles",
@@ -385,7 +385,7 @@
385385
},
386386
"AccessToken":{
387387
"type":"string",
388-
"max":2048,
388+
"max":4096,
389389
"pattern":"\\S+",
390390
"sensitive":true
391391
},
@@ -2610,6 +2610,11 @@
26102610
"max":2048,
26112611
"pattern":"[\\w!@#\\-.?,\\s]*"
26122612
},
2613+
"FlowErrorDeactivationThreshold":{
2614+
"type":"integer",
2615+
"max":100,
2616+
"min":1
2617+
},
26132618
"FlowExecutionList":{
26142619
"type":"list",
26152620
"member":{"shape":"ExecutionRecord"}
@@ -2862,6 +2867,7 @@
28622867
"error":{"httpStatusCode":500},
28632868
"exception":true
28642869
},
2870+
"JavaBoolean":{"type":"boolean"},
28652871
"KMSArn":{
28662872
"type":"string",
28672873
"max":2048,
@@ -3598,7 +3604,7 @@
35983604
},
35993605
"RefreshToken":{
36003606
"type":"string",
3601-
"max":1024,
3607+
"max":2048,
36023608
"pattern":"\\S+"
36033609
},
36043610
"Region":{
@@ -3734,7 +3740,11 @@
37343740
"shape":"PrefixConfig",
37353741
"documentation":"<p> Determines the prefix that Amazon AppFlow applies to the folder name in the Amazon S3 bucket. You can name folders according to the flow frequency and date. </p>"
37363742
},
3737-
"aggregationConfig":{"shape":"AggregationConfig"}
3743+
"aggregationConfig":{"shape":"AggregationConfig"},
3744+
"preserveSourceDataTyping":{
3745+
"shape":"JavaBoolean",
3746+
"documentation":"<p>If your file output format is Parquet, use this parameter to set whether Amazon AppFlow preserves the data types in your source data when it writes the output to Amazon S3. </p> <ul> <li> <p> <code>true</code>: Amazon AppFlow preserves the data types when it writes to Amazon S3. For example, an integer or <code>1</code> in your source data is still an integer in your output.</p> </li> <li> <p> <code>false</code>: Amazon AppFlow converts all of the source data into strings when it writes to Amazon S3. For example, an integer of <code>1</code> in your source data becomes the string <code>\"1\"</code> in the output.</p> </li> </ul>"
3747+
}
37383748
},
37393749
"documentation":"<p> The configuration that determines how Amazon AppFlow should format the flow output data when Amazon S3 is used as the destination. </p>"
37403750
},
@@ -4018,15 +4028,15 @@
40184028
},
40194029
"scheduleStartTime":{
40204030
"shape":"Date",
4021-
"documentation":"<p> Specifies the scheduled start time for a schedule-triggered flow. </p>"
4031+
"documentation":"<p>The time at which the scheduled flow starts. The time is formatted as a timestamp that follows the ISO 8601 standard, such as <code>2022-04-26T13:00:00-07:00</code>.</p>"
40224032
},
40234033
"scheduleEndTime":{
40244034
"shape":"Date",
4025-
"documentation":"<p> Specifies the scheduled end time for a schedule-triggered flow. </p>"
4035+
"documentation":"<p>The time at which the scheduled flow ends. The time is formatted as a timestamp that follows the ISO 8601 standard, such as <code>2022-04-27T13:00:00-07:00</code>.</p>"
40264036
},
40274037
"timezone":{
40284038
"shape":"Timezone",
4029-
"documentation":"<p> Specifies the time zone used when referring to the date and time of a scheduled-triggered flow, such as <code>America/New_York</code>. </p>"
4039+
"documentation":"<p>Specifies the time zone used when referring to the dates and times of a scheduled flow, such as <code>America/New_York</code>. This time zone is only a descriptive label. It doesn't affect how Amazon AppFlow interprets the timestamps that you specify to schedule the flow.</p> <p>If you want to schedule a flow by using times in a particular time zone, indicate the time zone as a UTC offset in your timestamps. For example, the UTC offsets for the <code>America/New_York</code> timezone are <code>-04:00</code> EDT and <code>-05:00 EST</code>.</p>"
40304040
},
40314041
"scheduleOffset":{
40324042
"shape":"ScheduleOffset",
@@ -4036,6 +4046,11 @@
40364046
"firstExecutionFrom":{
40374047
"shape":"Date",
40384048
"documentation":"<p> Specifies the date range for the records to import from the connector in the first flow run. </p>"
4049+
},
4050+
"flowErrorDeactivationThreshold":{
4051+
"shape":"FlowErrorDeactivationThreshold",
4052+
"documentation":"<p>Defines how many times a scheduled flow fails consecutively before Amazon AppFlow deactivates it.</p>",
4053+
"box":true
40394054
}
40404055
},
40414056
"documentation":"<p> Specifies the configuration details of a schedule-triggered flow as defined by the user. Currently, these settings only apply to the <code>Scheduled</code> trigger type. </p>"

0 commit comments

Comments
 (0)