Skip to content

Commit 3d46a39

Browse files
author
awstools
committed
feat(client-emr-containers): EMR on EKS now allows running Spark SQL using the newly introduced Spark SQL Job Driver in the Start Job Run API
1 parent 7141bb4 commit 3d46a39

19 files changed

+288
-111
lines changed

‎clients/client-emr-containers/README.md

Lines changed: 8 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,8 @@ AWS SDK for JavaScript EMRContainers Client for Node.js, Browser and React Nativ
1313
open-source big data frameworks on Amazon Elastic Kubernetes Service (Amazon EKS). With
1414
this deployment option, you can focus on running analytics workloads while Amazon EMR on
1515
EKS builds, configures, and manages containers for open-source applications. For more
16-
information about Amazon EMR on EKS concepts and tasks, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks.html">What is Amazon EMR on EKS</a>.</p>
16+
information about Amazon EMR on EKS concepts and tasks, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks.html">What is Amazon EMR on
17+
EKS</a>.</p>
1718
<p>
1819
<i>Amazon EMR containers</i> is the API name for Amazon EMR on EKS. The
1920
<code>emr-containers</code> prefix is used in the following scenarios: </p>
@@ -23,12 +24,14 @@ information about Amazon EMR on EKS concepts and tasks, see <a href="https://doc
2324
emr-containers start-job-run</code>.</p>
2425
</li>
2526
<li>
26-
<p>It is the prefix before IAM policy actions for Amazon EMR on EKS. For example, <code>"Action": [
27-
"emr-containers:StartJobRun"]</code>. For more information, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/security_iam_service-with-iam.html#security_iam_service-with-iam-id-based-policies-actions">Policy actions for Amazon EMR on EKS</a>.</p>
27+
<p>It is the prefix before IAM policy actions for Amazon EMR on EKS. For example,
28+
<code>"Action": [ "emr-containers:StartJobRun"]</code>. For more information, see
29+
<a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/security_iam_service-with-iam.html#security_iam_service-with-iam-id-based-policies-actions">Policy actions for Amazon EMR on EKS</a>.</p>
2830
</li>
2931
<li>
30-
<p>It is the prefix used in Amazon EMR on EKS service endpoints. For example, <code>emr-containers.us-east-2.amazonaws.com</code>. For more
31-
information, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/service-quotas.html#service-endpoints">Amazon EMR on EKS Service Endpoints</a>.</p>
32+
<p>It is the prefix used in Amazon EMR on EKS service endpoints. For example,
33+
<code>emr-containers.us-east-2.amazonaws.com</code>. For more information, see
34+
<a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/service-quotas.html#service-endpoints">Amazon EMR on EKS Service Endpoints</a>.</p>
3235
</li>
3336
</ul>
3437

‎clients/client-emr-containers/src/EMRContainers.ts

Lines changed: 55 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -71,7 +71,8 @@ import { EMRContainersClient } from "./EMRContainersClient";
7171
* open-source big data frameworks on Amazon Elastic Kubernetes Service (Amazon EKS). With
7272
* this deployment option, you can focus on running analytics workloads while Amazon EMR on
7373
* EKS builds, configures, and manages containers for open-source applications. For more
74-
* information about Amazon EMR on EKS concepts and tasks, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks.html">What is Amazon EMR on EKS</a>.</p>
74+
* information about Amazon EMR on EKS concepts and tasks, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks.html">What is Amazon EMR on
75+
* EKS</a>.</p>
7576
* <p>
7677
* <i>Amazon EMR containers</i> is the API name for Amazon EMR on EKS. The
7778
* <code>emr-containers</code> prefix is used in the following scenarios: </p>
@@ -81,18 +82,21 @@ import { EMRContainersClient } from "./EMRContainersClient";
8182
* emr-containers start-job-run</code>.</p>
8283
* </li>
8384
* <li>
84-
* <p>It is the prefix before IAM policy actions for Amazon EMR on EKS. For example, <code>"Action": [
85-
* "emr-containers:StartJobRun"]</code>. For more information, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/security_iam_service-with-iam.html#security_iam_service-with-iam-id-based-policies-actions">Policy actions for Amazon EMR on EKS</a>.</p>
85+
* <p>It is the prefix before IAM policy actions for Amazon EMR on EKS. For example,
86+
* <code>"Action": [ "emr-containers:StartJobRun"]</code>. For more information, see
87+
* <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/security_iam_service-with-iam.html#security_iam_service-with-iam-id-based-policies-actions">Policy actions for Amazon EMR on EKS</a>.</p>
8688
* </li>
8789
* <li>
88-
* <p>It is the prefix used in Amazon EMR on EKS service endpoints. For example, <code>emr-containers.us-east-2.amazonaws.com</code>. For more
89-
* information, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/service-quotas.html#service-endpoints">Amazon EMR on EKS Service Endpoints</a>.</p>
90+
* <p>It is the prefix used in Amazon EMR on EKS service endpoints. For example,
91+
* <code>emr-containers.us-east-2.amazonaws.com</code>. For more information, see
92+
* <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/service-quotas.html#service-endpoints">Amazon EMR on EKS Service Endpoints</a>.</p>
9093
* </li>
9194
* </ul>
9295
*/
9396
export class EMRContainers extends EMRContainersClient {
9497
/**
95-
* <p>Cancels a job run. A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.</p>
98+
* <p>Cancels a job run. A job run is a unit of work, such as a Spark jar, PySpark script, or
99+
* SparkSQL query, that you submit to Amazon EMR on EKS.</p>
96100
*/
97101
public cancelJobRun(
98102
args: CancelJobRunCommandInput,
@@ -121,7 +125,8 @@ export class EMRContainers extends EMRContainersClient {
121125
}
122126

123127
/**
124-
* <p>Creates a managed endpoint. A managed endpoint is a gateway that connects EMR Studio to Amazon EMR on EKS so that EMR Studio can communicate with your virtual cluster.</p>
128+
* <p>Creates a managed endpoint. A managed endpoint is a gateway that connects EMR Studio to
129+
* Amazon EMR on EKS so that EMR Studio can communicate with your virtual cluster.</p>
125130
*/
126131
public createManagedEndpoint(
127132
args: CreateManagedEndpointCommandInput,
@@ -153,7 +158,11 @@ export class EMRContainers extends EMRContainersClient {
153158
}
154159

155160
/**
156-
* <p>Creates a virtual cluster. Virtual cluster is a managed entity on Amazon EMR on EKS. You can create, describe, list and delete virtual clusters. They do not consume any additional resource in your system. A single virtual cluster maps to a single Kubernetes namespace. Given this relationship, you can model virtual clusters the same way you model Kubernetes namespaces to meet your requirements.</p>
161+
* <p>Creates a virtual cluster. Virtual cluster is a managed entity on Amazon EMR on EKS. You
162+
* can create, describe, list and delete virtual clusters. They do not consume any additional
163+
* resource in your system. A single virtual cluster maps to a single Kubernetes namespace.
164+
* Given this relationship, you can model virtual clusters the same way you model Kubernetes
165+
* namespaces to meet your requirements.</p>
157166
*/
158167
public createVirtualCluster(
159168
args: CreateVirtualClusterCommandInput,
@@ -185,7 +194,8 @@ export class EMRContainers extends EMRContainersClient {
185194
}
186195

187196
/**
188-
* <p>Deletes a managed endpoint. A managed endpoint is a gateway that connects EMR Studio to Amazon EMR on EKS so that EMR Studio can communicate with your virtual cluster.</p>
197+
* <p>Deletes a managed endpoint. A managed endpoint is a gateway that connects EMR Studio to
198+
* Amazon EMR on EKS so that EMR Studio can communicate with your virtual cluster.</p>
189199
*/
190200
public deleteManagedEndpoint(
191201
args: DeleteManagedEndpointCommandInput,
@@ -217,7 +227,11 @@ export class EMRContainers extends EMRContainersClient {
217227
}
218228

219229
/**
220-
* <p>Deletes a virtual cluster. Virtual cluster is a managed entity on Amazon EMR on EKS. You can create, describe, list and delete virtual clusters. They do not consume any additional resource in your system. A single virtual cluster maps to a single Kubernetes namespace. Given this relationship, you can model virtual clusters the same way you model Kubernetes namespaces to meet your requirements.</p>
230+
* <p>Deletes a virtual cluster. Virtual cluster is a managed entity on Amazon EMR on EKS. You
231+
* can create, describe, list and delete virtual clusters. They do not consume any additional
232+
* resource in your system. A single virtual cluster maps to a single Kubernetes namespace.
233+
* Given this relationship, you can model virtual clusters the same way you model Kubernetes
234+
* namespaces to meet your requirements.</p>
221235
*/
222236
public deleteVirtualCluster(
223237
args: DeleteVirtualClusterCommandInput,
@@ -249,7 +263,8 @@ export class EMRContainers extends EMRContainersClient {
249263
}
250264

251265
/**
252-
* <p>Displays detailed information about a job run. A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.</p>
266+
* <p>Displays detailed information about a job run. A job run is a unit of work, such as a
267+
* Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.</p>
253268
*/
254269
public describeJobRun(
255270
args: DescribeJobRunCommandInput,
@@ -281,7 +296,9 @@ export class EMRContainers extends EMRContainersClient {
281296
}
282297

283298
/**
284-
* <p>Displays detailed information about a managed endpoint. A managed endpoint is a gateway that connects EMR Studio to Amazon EMR on EKS so that EMR Studio can communicate with your virtual cluster.</p>
299+
* <p>Displays detailed information about a managed endpoint. A managed endpoint is a gateway
300+
* that connects EMR Studio to Amazon EMR on EKS so that EMR Studio can communicate with your
301+
* virtual cluster.</p>
285302
*/
286303
public describeManagedEndpoint(
287304
args: DescribeManagedEndpointCommandInput,
@@ -313,7 +330,12 @@ export class EMRContainers extends EMRContainersClient {
313330
}
314331

315332
/**
316-
* <p>Displays detailed information about a specified virtual cluster. Virtual cluster is a managed entity on Amazon EMR on EKS. You can create, describe, list and delete virtual clusters. They do not consume any additional resource in your system. A single virtual cluster maps to a single Kubernetes namespace. Given this relationship, you can model virtual clusters the same way you model Kubernetes namespaces to meet your requirements.</p>
333+
* <p>Displays detailed information about a specified virtual cluster. Virtual cluster is a
334+
* managed entity on Amazon EMR on EKS. You can create, describe, list and delete virtual
335+
* clusters. They do not consume any additional resource in your system. A single virtual
336+
* cluster maps to a single Kubernetes namespace. Given this relationship, you can model
337+
* virtual clusters the same way you model Kubernetes namespaces to meet your
338+
* requirements.</p>
317339
*/
318340
public describeVirtualCluster(
319341
args: DescribeVirtualClusterCommandInput,
@@ -345,7 +367,8 @@ export class EMRContainers extends EMRContainersClient {
345367
}
346368

347369
/**
348-
* <p>Lists job runs based on a set of parameters. A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.</p>
370+
* <p>Lists job runs based on a set of parameters. A job run is a unit of work, such as a
371+
* Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.</p>
349372
*/
350373
public listJobRuns(args: ListJobRunsCommandInput, options?: __HttpHandlerOptions): Promise<ListJobRunsCommandOutput>;
351374
public listJobRuns(args: ListJobRunsCommandInput, cb: (err: any, data?: ListJobRunsCommandOutput) => void): void;
@@ -371,7 +394,9 @@ export class EMRContainers extends EMRContainersClient {
371394
}
372395

373396
/**
374-
* <p>Lists managed endpoints based on a set of parameters. A managed endpoint is a gateway that connects EMR Studio to Amazon EMR on EKS so that EMR Studio can communicate with your virtual cluster.</p>
397+
* <p>Lists managed endpoints based on a set of parameters. A managed endpoint is a gateway
398+
* that connects EMR Studio to Amazon EMR on EKS so that EMR Studio can communicate with your
399+
* virtual cluster.</p>
375400
*/
376401
public listManagedEndpoints(
377402
args: ListManagedEndpointsCommandInput,
@@ -435,7 +460,11 @@ export class EMRContainers extends EMRContainersClient {
435460
}
436461

437462
/**
438-
* <p>Lists information about the specified virtual cluster. Virtual cluster is a managed entity on Amazon EMR on EKS. You can create, describe, list and delete virtual clusters. They do not consume any additional resource in your system. A single virtual cluster maps to a single Kubernetes namespace. Given this relationship, you can model virtual clusters the same way you model Kubernetes namespaces to meet your requirements.</p>
463+
* <p>Lists information about the specified virtual cluster. Virtual cluster is a managed
464+
* entity on Amazon EMR on EKS. You can create, describe, list and delete virtual clusters.
465+
* They do not consume any additional resource in your system. A single virtual cluster maps
466+
* to a single Kubernetes namespace. Given this relationship, you can model virtual clusters
467+
* the same way you model Kubernetes namespaces to meet your requirements.</p>
439468
*/
440469
public listVirtualClusters(
441470
args: ListVirtualClustersCommandInput,
@@ -467,7 +496,8 @@ export class EMRContainers extends EMRContainersClient {
467496
}
468497

469498
/**
470-
* <p>Starts a job run. A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.</p>
499+
* <p>Starts a job run. A job run is a unit of work, such as a Spark jar, PySpark script, or
500+
* SparkSQL query, that you submit to Amazon EMR on EKS.</p>
471501
*/
472502
public startJobRun(args: StartJobRunCommandInput, options?: __HttpHandlerOptions): Promise<StartJobRunCommandOutput>;
473503
public startJobRun(args: StartJobRunCommandInput, cb: (err: any, data?: StartJobRunCommandOutput) => void): void;
@@ -493,7 +523,14 @@ export class EMRContainers extends EMRContainersClient {
493523
}
494524

495525
/**
496-
* <p>Assigns tags to resources. A tag is a label that you assign to an AWS resource. Each tag consists of a key and an optional value, both of which you define. Tags enable you to categorize your AWS resources by attributes such as purpose, owner, or environment. When you have many resources of the same type, you can quickly identify a specific resource based on the tags you've assigned to it. For example, you can define a set of tags for your Amazon EMR on EKS clusters to help you track each cluster's owner and stack level. We recommend that you devise a consistent set of tag keys for each resource type. You can then search and filter the resources based on the tags that you add.</p>
526+
* <p>Assigns tags to resources. A tag is a label that you assign to an AWS resource. Each tag
527+
* consists of a key and an optional value, both of which you define. Tags enable you to
528+
* categorize your AWS resources by attributes such as purpose, owner, or environment. When
529+
* you have many resources of the same type, you can quickly identify a specific resource
530+
* based on the tags you've assigned to it. For example, you can define a set of tags for your
531+
* Amazon EMR on EKS clusters to help you track each cluster's owner and stack level. We
532+
* recommend that you devise a consistent set of tag keys for each resource type. You can then
533+
* search and filter the resources based on the tags that you add.</p>
497534
*/
498535
public tagResource(args: TagResourceCommandInput, options?: __HttpHandlerOptions): Promise<TagResourceCommandOutput>;
499536
public tagResource(args: TagResourceCommandInput, cb: (err: any, data?: TagResourceCommandOutput) => void): void;

‎clients/client-emr-containers/src/EMRContainersClient.ts

Lines changed: 8 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -289,7 +289,8 @@ export interface EMRContainersClientResolvedConfig extends EMRContainersClientRe
289289
* open-source big data frameworks on Amazon Elastic Kubernetes Service (Amazon EKS). With
290290
* this deployment option, you can focus on running analytics workloads while Amazon EMR on
291291
* EKS builds, configures, and manages containers for open-source applications. For more
292-
* information about Amazon EMR on EKS concepts and tasks, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks.html">What is Amazon EMR on EKS</a>.</p>
292+
* information about Amazon EMR on EKS concepts and tasks, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/emr-eks.html">What is Amazon EMR on
293+
* EKS</a>.</p>
293294
* <p>
294295
* <i>Amazon EMR containers</i> is the API name for Amazon EMR on EKS. The
295296
* <code>emr-containers</code> prefix is used in the following scenarios: </p>
@@ -299,12 +300,14 @@ export interface EMRContainersClientResolvedConfig extends EMRContainersClientRe
299300
* emr-containers start-job-run</code>.</p>
300301
* </li>
301302
* <li>
302-
* <p>It is the prefix before IAM policy actions for Amazon EMR on EKS. For example, <code>"Action": [
303-
* "emr-containers:StartJobRun"]</code>. For more information, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/security_iam_service-with-iam.html#security_iam_service-with-iam-id-based-policies-actions">Policy actions for Amazon EMR on EKS</a>.</p>
303+
* <p>It is the prefix before IAM policy actions for Amazon EMR on EKS. For example,
304+
* <code>"Action": [ "emr-containers:StartJobRun"]</code>. For more information, see
305+
* <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/security_iam_service-with-iam.html#security_iam_service-with-iam-id-based-policies-actions">Policy actions for Amazon EMR on EKS</a>.</p>
304306
* </li>
305307
* <li>
306-
* <p>It is the prefix used in Amazon EMR on EKS service endpoints. For example, <code>emr-containers.us-east-2.amazonaws.com</code>. For more
307-
* information, see <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/service-quotas.html#service-endpoints">Amazon EMR on EKS Service Endpoints</a>.</p>
308+
* <p>It is the prefix used in Amazon EMR on EKS service endpoints. For example,
309+
* <code>emr-containers.us-east-2.amazonaws.com</code>. For more information, see
310+
* <a href="https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/service-quotas.html#service-endpoints">Amazon EMR on EKS Service Endpoints</a>.</p>
308311
* </li>
309312
* </ul>
310313
*/

‎clients/client-emr-containers/src/commands/CancelJobRunCommand.ts

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,8 @@ export interface CancelJobRunCommandInput extends CancelJobRunRequest {}
2828
export interface CancelJobRunCommandOutput extends CancelJobRunResponse, __MetadataBearer {}
2929

3030
/**
31-
* <p>Cancels a job run. A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.</p>
31+
* <p>Cancels a job run. A job run is a unit of work, such as a Spark jar, PySpark script, or
32+
* SparkSQL query, that you submit to Amazon EMR on EKS.</p>
3233
* @example
3334
* Use a bare-bones client and the command you need to make an API call.
3435
* ```javascript

‎clients/client-emr-containers/src/commands/CreateManagedEndpointCommand.ts

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,8 @@ export interface CreateManagedEndpointCommandInput extends CreateManagedEndpoint
2828
export interface CreateManagedEndpointCommandOutput extends CreateManagedEndpointResponse, __MetadataBearer {}
2929

3030
/**
31-
* <p>Creates a managed endpoint. A managed endpoint is a gateway that connects EMR Studio to Amazon EMR on EKS so that EMR Studio can communicate with your virtual cluster.</p>
31+
* <p>Creates a managed endpoint. A managed endpoint is a gateway that connects EMR Studio to
32+
* Amazon EMR on EKS so that EMR Studio can communicate with your virtual cluster.</p>
3233
* @example
3334
* Use a bare-bones client and the command you need to make an API call.
3435
* ```javascript

0 commit comments

Comments
 (0)