Skip to content

Starter Task 1: Get learning rate for llm_pte_finetuning example from config file #11445

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jun 7, 2025

Conversation

IshanAryendu
Copy link
Contributor

Summary:

  1. Cloned Repository: Cloned the Qwen2-0.5B-Instruct repository from HuggingFace onto local desktop.
  2. Uploaded Files to OD Server: Uploaded cloned files to OD server (57651.od.fbinfra.net) at /tmp/Qwen2-0.5B-Instruct.
  3. Created a New Directory to save the pte model: Created a new directory model under fbcode/executorch/examples/llm_pte_finetuning.
  4. Configured Learning Rate: Updated qwen_05b_config.yaml file to set the learning rate to 5e-3 under model config parameters (line 22).
  5. Updated Runner Script: Modified runner.py file to use the learning rate from cfg.model.learning_rate (line 87).

Reviewed By: silverguo

Differential Revision: D75807517

Copy link

pytorch-bot bot commented Jun 6, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/11445

Note: Links to docs will display an error until the docs builds have been completed.

⏳ No Failures, 1 Pending

As of commit a5b9633 with merge base 2bb567f (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported labels Jun 6, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D75807517

Copy link

github-actions bot commented Jun 6, 2025

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D75807517

IshanAryendu added a commit to IshanAryendu/executorch that referenced this pull request Jun 6, 2025
… config file (pytorch#11445)

Summary:
Pull Request resolved: pytorch#11445

1. Cloned Repository: Cloned the Qwen2-0.5B-Instruct repository from HuggingFace onto local desktop.
2. Uploaded Files to OD Server: Uploaded cloned files to OD server (57651.od.fbinfra.net) at /tmp/Qwen2-0.5B-Instruct.
3. Created a New Directory to save the pte model: Created a new directory model under fbcode/executorch/examples/llm_pte_finetuning.
4. Configured Learning Rate: Updated qwen_05b_config.yaml file to set the learning rate to 5e-3 under model config parameters (line 22).
5. Updated Runner Script: Modified runner.py file to use the learning rate from cfg.model.learning_rate (line 87).

Reviewed By: silverguo

Differential Revision: D75807517
IshanAryendu added a commit to IshanAryendu/executorch that referenced this pull request Jun 6, 2025
… config file (pytorch#11445)

Summary:

1. **Cloned Repository**: Cloned the relevant repository from a source onto the local desktop.
2. **Uploaded Files to Server**: Uploaded the cloned files to the server at `/tmp/Qwen2-0.5B-Instruct`.
3. **Created a New Directory for Model**: Created a new directory named `model` under `fbcode/executorch/examples/llm_pte_finetuning`.
4. **Configured Learning Rate**: Updated the configuration file to set the `learning_rate` to `5e-3` under model configuration parameters.
5. **Updated Runner Script**: Modified the script to use the learning rate from the configuration settings.

Reviewed By: mcr229, silverguo

Differential Revision: D75807517
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D75807517

IshanAryendu added a commit to IshanAryendu/executorch that referenced this pull request Jun 6, 2025
… config file (pytorch#11445)

Summary:

1. **Cloned Repository**: Cloned the relevant repository from a source onto the local desktop.
2. **Uploaded Files to Server**: Uploaded the cloned files to the server at `/tmp/Qwen2-0.5B-Instruct`.
3. **Created a New Directory for Model**: Created a new directory named `model` under `fbcode/executorch/examples/llm_pte_finetuning`.
4. **Configured Learning Rate**: Updated the configuration file to set the `learning_rate` to `5e-3` under model configuration parameters.
5. **Updated Runner Script**: Modified the script to use the learning rate from the configuration settings.

Reviewed By: mcr229, silverguo

Differential Revision: D75807517
… config file (pytorch#11445)

Summary:
Pull Request resolved: pytorch#11445

1. **Cloned Repository**: Cloned the relevant repository from a source onto the local desktop.
2. **Uploaded Files to Server**: Uploaded the cloned files to the server at `/tmp/Qwen2-0.5B-Instruct`.
3. **Created a New Directory for Model**: Created a new directory named `model` under `fbcode/executorch/examples/llm_pte_finetuning`.
4. **Configured Learning Rate**: Updated the configuration file to set the `learning_rate` to `5e-3` under model configuration parameters.
5. **Updated Runner Script**: Modified the script to use the learning rate from the configuration settings.

Reviewed By: mcr229, silverguo

Differential Revision: D75807517
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D75807517

@facebook-github-bot facebook-github-bot merged commit ae6b1f1 into pytorch:main Jun 7, 2025
104 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants