Skip to content

[SYCL] Improve memobj creation for devices w/o host unified memory #2761

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Nov 18, 2020

Conversation

sergey-semenov
Copy link
Contributor

The aggressive use of USE_HOST_PTR memory object creation option led to
significant performance overhead on devices without host unified memory
support. Furthermore, any discard access modes were ignored during the
allocation leading to unnecessary copy.

This patch makes it so that allocations for such devices are made with
COPY_HOST_PTR instead, and only if necessitated by the access mode.
These allocations are also not linked anymore, since linked allocations
rely on USE_HOST_PTR option.

The aggressive use of USE_HOST_PTR memory object creation option led to
significant performance overhead on devices without host unified memory
support. Furthermore, any discard access modes were ignored during the
allocation leading to unnecessary copy.

This patch makes it so that allocations for such devices are made with
COPY_HOST_PTR instead, and only if necessitated by the access mode.
These allocations are also not linked anymore, since linked allocations
rely on USE_HOST_PTR option.
@sergey-semenov sergey-semenov requested a review from a team as a code owner November 11, 2020 17:07
@sergey-semenov
Copy link
Contributor Author

TBD: add tests

@sergey-semenov sergey-semenov changed the title [SYCL] Improve MemObj creation for devices w/o host unified memory [SYCL] Improve memobj creation for devices w/o host unified memory Nov 11, 2020
@sergey-semenov
Copy link
Contributor Author

Note: there's a non-breaking ABI change in the latest version of the PR, a new symbol is added to SYCLMemObjT.

@sergey-semenov
Copy link
Contributor Author

/summary:run

Copy link
Contributor

@romanovvlad romanovvlad left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@romanovvlad romanovvlad merged commit a4f0924 into intel:sycl Nov 18, 2020
@sergey-semenov sergey-semenov deleted the improvememobjcreation branch November 18, 2020 12:02
jsji pushed a commit that referenced this pull request Nov 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants