Skip to content

Nightly Slurm CI Rocky update workflow #440

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 50 commits into from
Oct 10, 2024
Merged

Nightly Slurm CI Rocky update workflow #440

merged 50 commits into from
Oct 10, 2024

Conversation

bertiethorpe
Copy link
Member

@bertiethorpe bertiethorpe commented Sep 18, 2024

  • New workflow pre-builds ofed and cuda packages into "latest" images, nightly.
  • "Latest" images are synced across CI clouds.
  • Normal fatimage workflow then uses these "latest" nightly images as new source images.
  • Trivy scan adjusted to run on the nightly base image builds, and on merge to main in separate workflow.

@bertiethorpe bertiethorpe force-pushed the ci/nightly-builds branch 2 times, most recently from a965e2b to 942d004 Compare September 18, 2024 14:39
@github-advanced-security
Copy link

This pull request sets up GitHub code scanning for this repository. Once the scans have completed and the checks have passed, the analysis results for this pull request branch will appear on this overview. Once you merge this pull request, the 'Security' tab will show more code scanning analysis results (for example, for the default branch). Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results. For more information about GitHub code scanning, check out the documentation.

@bertiethorpe bertiethorpe force-pushed the ci/nightly-builds branch 3 times, most recently from bae008e to 2a02c3f Compare October 4, 2024 09:24
@bertiethorpe
Copy link
Member Author

Copy link
Collaborator

@sjpb sjpb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some minor nits.

@bertiethorpe bertiethorpe force-pushed the ci/nightly-builds branch 2 times, most recently from bbce75b to ae9f7f9 Compare October 9, 2024 10:13
@bertiethorpe

This comment was marked as outdated.

@bertiethorpe bertiethorpe requested a review from sjpb October 9, 2024 13:05
@bertiethorpe
Copy link
Member Author

@bertiethorpe bertiethorpe requested a review from sjpb October 10, 2024 08:36
Copy link
Collaborator

@sjpb sjpb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@sjpb sjpb merged commit a7fbdaf into main Oct 10, 2024
6 checks passed
@sjpb sjpb deleted the ci/nightly-builds branch October 10, 2024 10:26
MaxBed4d pushed a commit that referenced this pull request Oct 15, 2024
* Update openstack.pkr.hcl

* new image build workflow

* dynamically set packer vars from fatimage workflow

* remove openstack. prefix from image name

* echo image name

* make image_name var in packer config

* new changes

* fix merge changes

* temp workflow changes

* test nightly build

* change back fatimage workflow

* rename images built

* add update to builder group

* add update to fatimage build groups

* fatimage.yml fix

* move output image_name declaration into build blocks

* delete outdated nightly image

* test new fatimage build

* debug dnf remove cockpit

* --amend

* add cuda build back in

* cuda nightly build

* test cuda nightly builds

* test new fatimage build on SMS

* test image upploads across clouds

* test image uploads in separate workflow

* finish nightly build workflow

* fix image delete logic

* use azimuth-cloud trivy db mirror

* use GITHUB_TOKEN env

* test new fatimage build

* add final nightlybuilds workflow

* move trivy scan to separate workflow

* bump image and test new trivy scan

* fix artifact creation

* bump image and test trivy scan

* only run trivy scan on image bumps

* bump image to test trivy scan run condition

* bump cuda image

* bump image

* extend timeout for trivy scanning cuda image

* Run workflow on PR to main

* address PR comments

* fix source_image_name packer parse

* bump image

* additional PR comments

* bump image
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants