Skip to content

Build torch and lightgbm from source. #1083

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Oct 5, 2021
Merged

Build torch and lightgbm from source. #1083

merged 4 commits into from
Oct 5, 2021

Conversation

rosbo
Copy link
Contributor

@rosbo rosbo commented Oct 1, 2021

Fixes #984, #1059

Introduced a new "architecture" to easily build packages from source in
the main build only if needed (i.e. if the base image or the package
version has changed).

This enable us to:

  • Upgrade PyTorch which doesn't have a wheel for 1.9.1 and CUDA 11. This prevented us
    from upgrading torch for ~6 months.
  • Move the lightgbm gpu source build to this architecture to shave ~3
    minutes off the build time.

http://b/181966788

@rosbo rosbo requested a review from Philmod October 1, 2021 22:39
Fixes #984, #1059

Introduced a new "architecture" to easily build packages from source in
the main build only if needed (i.e. if the base image or the package
version has changed).

This enable us to:
- Upgrade PyTorch which doesn't have a wheel for 1.9.1 and CUDA 11. This prevented us
from upgrading torch for ~6 months.
- Move the lightgbm gpu source build to this architecture to shave ~3
minutes off the build time.

http://b/181966788
@rosbo rosbo requested a review from djherbis October 4, 2021 16:51
@rosbo rosbo merged commit e34c886 into main Oct 5, 2021
@rosbo rosbo deleted the build-packages branch October 5, 2021 01:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update pytorch from 1.7.0 to 1.8.1
2 participants