feature: add spark processing support to processing jobs

[metrizable]

Issue #, if available:

Description of changes:

SageMaker provides two classes for customers to run Spark applications:

• sagemaker.processing.PySparkProcessor: a class to run PySpark scripts as processing jobs
• sagemaker.processing.SparkJarProcessor: a class to run Spark scripts as processing jobs

Testing done:

unit:

❯ tox --parallel 3 -- -rfE --disable-warnings tests/unit
✔ OK black-format in 10.1 seconds
✔ OK flake8 in 26.412 seconds
✔ OK docstyle in 30.273 seconds
✔ OK pylint in 40.708 seconds
✔ OK doc8 in 41.82 seconds
✔ OK twine in 41.957 seconds
✔ OK sphinx in 3 minutes, 9.374 seconds
✔ OK py36 in 8 minutes, 18.834 seconds
✔ OK py37 in 8 minutes, 26.497 seconds
✔ OK py38 in 6 minutes, 54.403 seconds

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

• I have read the CONTRIBUTING doc
• I used the commit message format described in CONTRIBUTING
• I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
• I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

• I have added tests that prove my fix is effective or that my feature works (if appropriate)
• I have checked that my tests are not configured for a specific region or account (if appropriate)
• I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-python-sdk-unit-tests
• Commit ID: 020b339
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-python-sdk-unit-tests
• Commit ID: 020b339
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-python-sdk-notebook-tests
• Commit ID: 020b339
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-python-sdk-pr
• Commit ID: 020b339
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[sagemaker-bot]

AWS CodeBuild CI Report

• CodeBuild project: sagemaker-python-sdk-local-mode-tests
• Commit ID: 020b339
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository