Skip to content

Commit ebe3ad9

Browse files
iseeyuankartikayk
andauthored
Update examples/models/llama2/README.md
Co-authored-by: Kartikay Khandelwal <[email protected]>
1 parent b9e666b commit ebe3ad9

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/models/llama2/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -96,7 +96,7 @@ If you want to deploy and run a smaller model for educational purposes. From `ex
9696
9797
If you want to finetune your model based on a specific dataset, PyTorch provides [TorchTune](https://github.com/pytorch/torchtune) - a native-Pytorch library for easily authoring, fine-tuning and experimenting with LLMs.
9898
99-
Once you have [TorchTune installed](https://github.com/pytorch/torchtune?tab=readme-ov-file#get-started) you can finetune Llama2 7B model using LoRA on a single GPU, using the following command:
99+
Once you have [TorchTune installed](https://github.com/pytorch/torchtune?tab=readme-ov-file#get-started) you can finetune Llama2 7B model using LoRA on a single GPU, using the following command. This will produce a checkpoint where the LoRA weights are merged with the base model and so the output checkpoint will be in the same format as the original Llama2 model.
100100
101101
102102
tune run lora_finetune_single_device \

0 commit comments

Comments
 (0)