Skip to content

Remove Public Endpoint from EKS Platform #139

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 8 commits into from

Conversation

harrryr
Copy link
Contributor

@harrryr harrryr commented Jul 26, 2024

Issue description:
This is a part of four series of PR to remove public endpoints for E2E testing to comply with security best practices.

Since the public endpoints will be removed, we are unable to call the sample app APIs directly from the workflow. Therefore, we will be using a traffic generator that is installed alongside the sample app applications to call the APIs

This PR is responsible for removing public endpoints from EKS platform.

Description of changes:

  • Deploy the traffic generator in the sample app namespace.
  • Stop creating ingress port for the EKS
  • Remove HttpCaller from the validator and update the trace validator to search for traces using filters rather than traceId

Test run: https://github.com/aws-observability/aws-application-signals-test-framework/actions/runs/10134510362

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@harrryr harrryr force-pushed the remove-public-endpoint-eks branch 3 times, most recently from 247c7b0 to 768647f Compare July 26, 2024 22:44
@harrryr harrryr force-pushed the remove-public-endpoint-eks branch from 768647f to 6f59ef4 Compare July 28, 2024 20:21
harrryr added a commit that referenced this pull request Jul 29, 2024
*Issue description:*
This is a part of four series of PR to remove public endpoints for E2E
testing to comply with security best practices.
- [Deploy Traffic
Generator](#140)
- [Remove Public Endpoints from
K8s](#141)
- [Remove Public Endpoints from
EKS](#139)
- [Remove Public Endpoints from
EC2](#144)

Since the public endpoints will be removed, we are unable to call the
sample app APIs directly from the workflow. Therefore, we will be using
a traffic generator that is installed alongside the sample app
applications to call the APIs

This PR will be responsible for creating the traffic generator as well
as saving them to private ECR and S3 bucket.
The private ECR will be used by EKS and K8s platform while the S3 bucket
will be used by EC2 Platforms.

The traffic generator will first wait while it receives the appropriate
environment variable. Once that is received, it will ping the API
endpoints every minute. There is some additional logic depending on
which canary it is running for.

Test run:
https://github.com/aws-observability/aws-application-signals-test-framework/actions/runs/10118562925
Test run after comment:
https://github.com/aws-observability/aws-application-signals-test-framework/actions/runs/10148623963

By submitting this pull request, I confirm that my contribution is made
under the terms of the Apache 2.0 license.
harrryr added 4 commits July 29, 2024 13:47
*Issue description:*

*Description of changes:*

*Ensure you've run the following tests on your changes and include the
link below:*
To do so, create a `test.yml` file with `name: Test` and workflow
description to test your changes, then remove the file for your PR. Link
your test run in your PR description. This process is a short term
solution while we work on creating a staging environment for testing.

NOTE: TESTS RUNNING ON A SINGLE EKS CLUSTER CANNOT BE RUN IN PARALLEL.
See the
[needs](https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_idneeds)
keyword to run tests in succession.
- Run Java EKS on `e2e-playground` in us-east-1 and eu-central-2
- Run Python EKS on `e2e-playground` in us-east-1 and eu-central-2
- Run metric limiter on EKS cluster `e2e-playground` in us-east-1 and
eu-central-2
- Run EC2 tests in all regions
- Run K8s on a separate K8s cluster (check IAD test account for master
node endpoints; these will change as we create and destroy clusters for
OS patching)

By submitting this pull request, I confirm that my contribution is made
under the terms of the Apache 2.0 license.
@harrryr harrryr closed this Jul 30, 2024
@harrryr harrryr deleted the remove-public-endpoint-eks branch August 23, 2024 18:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant