Skip to content

Fix leaked futures when executor rejects Runnable #4009

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
May 16, 2023

Conversation

dagnir
Copy link
Contributor

@dagnir dagnir commented May 15, 2023

Motivation and Context

This commit fixes an issue where CompletableFutures are leaked/never completed when the submission to the FUTURE_COMPLETE_EXECUTOR is rejected.

By default, the SDK uses 2 * number of cores (with a maximum of 64), and uses bounded queue of size 1000. In cases where the throughput to the client exceeds the executor's ability to keep up, it would reject executions, and previously, this would lead to leaked futures.

Modifications

Testing

  • Unit tests.
  • Integ tests.

Screenshots (if appropriate)

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)

Checklist

  • I have read the CONTRIBUTING document
  • Local run of mvn install succeeds
  • My code follows the code style of this project
  • My change requires a change to the Javadoc documentation
  • I have updated the Javadoc documentation accordingly
  • I have added tests to cover my changes
  • All new and existing tests passed
  • I have added a changelog entry. Adding a new entry must be accomplished by running the scripts/new-change script and following the instructions. Commit the new file created by the script in .changes/next-release with your changes.
  • My change is to implement 1.11 parity feature and I have updated LaunchChangelog

License

  • I confirm that this pull request can be released under the Apache 2 license

This commit fixes  an issue where CompletableFutures are leaked/never completed
when the submission to the FUTURE_COMPLETE_EXECUTOR is rejected.

By default, the SDK uses 2 * number of cores (with a maximum of 64), and uses
bounded queue of size 1000. In cases where the throughput to the client exceeds
the executor's ability to keep up, it would reject executions, and previously,
this would lead to leaked futures.
@dagnir dagnir force-pushed the dongie/fix-future-rejection-issue branch from 2973059 to 8e66ced Compare May 15, 2023 21:06
@dagnir dagnir marked this pull request as ready for review May 15, 2023 21:13
@dagnir dagnir requested a review from a team as a code owner May 15, 2023 21:13
@dagnir dagnir enabled auto-merge (squash) May 16, 2023 18:01
@dagnir dagnir disabled auto-merge May 16, 2023 18:46
@sonarqubecloud
Copy link

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

93.8% 93.8% Coverage
0.0% 0.0% Duplication

@dagnir dagnir merged commit 754d525 into master May 16, 2023
@dagnir dagnir deleted the dongie/fix-future-rejection-issue branch May 16, 2023 20:28
@dagnir dagnir mentioned this pull request May 17, 2023
12 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants