[SOW MS3] Centos stream9 PyTorch image support #1090

rraminen · 2022-08-23T18:21:48Z

This is to generate CS9 PyTorch images.

cc: @pruthvistony

pruthvistony

Please check the comments.

.circleci/docker/common/install_base.sh

.circleci/docker/common/install_rocm.sh

.circleci/docker/common/install_base.sh

.circleci/docker/common/install_rocm.sh

rraminen · 2022-08-29T15:45:43Z

I am running into this error while building the cs9 image

Traceback (most recent call last):
File "/opt/conda/bin/conda", line 13, in
sys.exit(main())
File "/opt/conda/lib/python3.9/site-packages/conda/cli/main.py", line 129, in main
File "/opt/conda/lib/python3.9/site-packages/conda/exceptions.py", line 1413, in conda_exception_handler
File "/opt/conda/lib/python3.9/site-packages/conda/exceptions.py", line 1128, in call
File "/opt/conda/lib/python3.9/site-packages/conda/exceptions.py", line 1170, in handle_exception
File "/opt/conda/lib/python3.9/site-packages/conda/exceptions.py", line 1181, in handle_unexpected_exception
File "/opt/conda/lib/python3.9/site-packages/conda/exceptions.py", line 1251, in print_unexpected_error_report
ModuleNotFoundError: No module named 'conda.cli.main_info'

@pruthvistony, have you come across this?

pruthvistony · 2022-08-29T16:28:08Z

I am running into this error while building the cs9 image

Traceback (most recent call last): File "/opt/conda/bin/conda", line 13, in sys.exit(main()) File "/opt/conda/lib/python3.9/site-packages/conda/cli/main.py", line 129, in main File "/opt/conda/lib/python3.9/site-packages/conda/exceptions.py", line 1413, in conda_exception_handler File "/opt/conda/lib/python3.9/site-packages/conda/exceptions.py", line 1128, in call File "/opt/conda/lib/python3.9/site-packages/conda/exceptions.py", line 1170, in handle_exception File "/opt/conda/lib/python3.9/site-packages/conda/exceptions.py", line 1181, in handle_unexpected_exception File "/opt/conda/lib/python3.9/site-packages/conda/exceptions.py", line 1251, in print_unexpected_error_report ModuleNotFoundError: No module named 'conda.cli.main_info'

@pruthvistony, have you come across this?

Pull this patch
5fba5bb

pruthvistony

more of a NIT change

.circleci/docker/common/install_base.sh

rraminen · 2022-08-30T01:23:59Z

Image built successfully for centos 7

> cd ~/pytorch/.circleci/docker
> PYTORCH_ROCM_ARCH=gfx908 ./build.sh pytorch-devtoolset7-centos7.5.1804-rocm5.2-py3.7

Image built successfully for centos stream 9

> cd ~/pytorch/.circleci/docker
> PYTORCH_ROCM_ARCH=gfx908 ./build.sh pytorch-devtoolset9-centos9-rocm5.2-py3.9

Verified PyTorch build in both the above images

> $ sudo /opt/conda/bin/python -c "import torch;print(torch.cuda.is_available())"
> True

jithunnair-amd

LGTM

* changes to build Centos stream 9 images * Added scripts for centos and centos stream images * Added an extra line * Add ninja installation * Optimized code * Fixes * Add comment * Optimized code * Added AMDGPU mapping for ROCm 5.2 and invalid-url for rocm_baseurl Co-authored-by: Jithun Nair <[email protected]>

* changes to build Centos stream 9 images * Added scripts for centos and centos stream images * Added an extra line * Add ninja installation * Optimized code * Fixes * Add comment * Optimized code * Added AMDGPU mapping for ROCm 5.2 and invalid-url for rocm_baseurl Co-authored-by: Jithun Nair <[email protected]> Updated to latest conda for CentOS stream 9 [CS9] Updates to CentOS stream 9 build (#1326) - Add missing common_utils.sh - Update the install vision part - Move to amdgpu rhel 9.3 builds - Update to pick python from conda path - Add a missing package - Add ROCM_PATH and magma - Updated repo radeon path

==================================================== [SOW MS3] Centos stream9 PyTorch image support (#1090) * changes to build Centos stream 9 images * Added scripts for centos and centos stream images * Added an extra line * Add ninja installation * Optimized code * Fixes * Add comment * Optimized code * Added AMDGPU mapping for ROCm 5.2 and invalid-url for rocm_baseurl Co-authored-by: Jithun Nair <[email protected]> Updated to latest conda for CentOS stream 9 [CS9] Updates to CentOS stream 9 build (#1326) - Add missing common_utils.sh - Update the install vision part - Move to amdgpu rhel 9.3 builds - Update to pick python from conda path - Add a missing package - Add ROCM_PATH and magma - Updated repo radeon path

==================================================== [SOW MS3] Centos stream9 PyTorch image support (#1090) * changes to build Centos stream 9 images * Added scripts for centos and centos stream images * Added an extra line * Add ninja installation * Optimized code * Fixes * Add comment * Optimized code * Added AMDGPU mapping for ROCm 5.2 and invalid-url for rocm_baseurl Co-authored-by: Jithun Nair <[email protected]> Updated to latest conda for CentOS stream 9 [CS9] Updates to CentOS stream 9 build (#1326) - Add missing common_utils.sh - Update the install vision part - Move to amdgpu rhel 9.3 builds - Update to pick python from conda path - Add a missing package - Add ROCM_PATH and magma - Updated repo radeon path (cherry picked from commit 51ce1cc)

==================================================== [SOW MS3] Centos stream9 PyTorch image support (#1090) * changes to build Centos stream 9 images * Added scripts for centos and centos stream images * Added an extra line * Add ninja installation * Optimized code * Fixes * Add comment * Optimized code * Added AMDGPU mapping for ROCm 5.2 and invalid-url for rocm_baseurl Co-authored-by: Jithun Nair <[email protected]> Updated to latest conda for CentOS stream 9 [CS9] Updates to CentOS stream 9 build (#1326) - Add missing common_utils.sh - Update the install vision part - Move to amdgpu rhel 9.3 builds - Update to pick python from conda path - Add a missing package - Add ROCM_PATH and magma - Updated repo radeon path (cherry picked from commit 51ce1cc) [rocm6.4_internal_testing] Update missing changes for CentOS9 (#1813) To fix, https://ontrack-internal.amd.com/browse/SWDEV-505385 and https://ontrack-internal.amd.com/browse/SWDEV-507301 (cherry picked from commit 956c145) delete .ci/docker/common/install_db.sh

rraminen added 4 commits August 22, 2022 14:56

changes to build Centos stream 9 images

9546d1e

Added scripts for centos and centos stream images

c95b27c

Added an extra line

41ee02b

Add ninja installation

f0a9c9c

rraminen requested a review from jeffdaily as a code owner August 23, 2022 18:21

jithunnair-amd changed the title ~~centos stream9 PyTorch image support~~ [SOW MS3] Centos stream9 PyTorch image support Aug 23, 2022

jithunnair-amd self-requested a review August 23, 2022 21:12

pruthvistony reviewed Aug 24, 2022

View reviewed changes

.circleci/docker/common/install_base.sh Outdated Show resolved Hide resolved

.circleci/docker/common/install_rocm.sh Outdated Show resolved Hide resolved

jithunnair-amd requested changes Aug 26, 2022

View reviewed changes

.circleci/docker/common/install_base.sh Show resolved Hide resolved

.circleci/docker/common/install_base.sh Show resolved Hide resolved

.circleci/docker/common/install_rocm.sh Outdated Show resolved Hide resolved

Optimized code

8cd2ca6

pruthvistony approved these changes Aug 26, 2022

View reviewed changes

Fixes

c814792

jithunnair-amd reviewed Aug 29, 2022

View reviewed changes

.circleci/docker/common/install_rocm.sh Show resolved Hide resolved

Add comment

011388d

pruthvistony reviewed Aug 29, 2022

View reviewed changes

.circleci/docker/common/install_base.sh Outdated Show resolved Hide resolved

rraminen added 2 commits August 29, 2022 21:14

Optimized code

a8955c8

Added AMDGPU mapping for ROCm 5.2 and invalid-url for rocm_baseurl

0d5e682

jithunnair-amd approved these changes Aug 30, 2022

View reviewed changes

jithunnair-amd merged commit 95aa0e7 into sow_ms3 Aug 30, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[SOW MS3] Centos stream9 PyTorch image support #1090

[SOW MS3] Centos stream9 PyTorch image support #1090

Uh oh!

rraminen commented Aug 23, 2022

Uh oh!

pruthvistony left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

rraminen commented Aug 29, 2022

Uh oh!

pruthvistony commented Aug 29, 2022

Uh oh!

pruthvistony left a comment

Uh oh!

Uh oh!

rraminen commented Aug 30, 2022 •

edited

Loading

Uh oh!

jithunnair-amd left a comment

Uh oh!

Uh oh!

[SOW MS3] Centos stream9 PyTorch image support #1090

[SOW MS3] Centos stream9 PyTorch image support #1090

Uh oh!

Conversation

rraminen commented Aug 23, 2022

Uh oh!

pruthvistony left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

rraminen commented Aug 29, 2022

Uh oh!

pruthvistony commented Aug 29, 2022

Uh oh!

pruthvistony left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

rraminen commented Aug 30, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jithunnair-amd left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

rraminen commented Aug 30, 2022 •

edited

Loading