Skip to content

Commit 5c33c63

Browse files
danbevjordankanter
authored andcommitted
finetune : add training data file to log message (ggml-org#4979)
This commit adds the name of the training data file to the log message printed when the training data is tokenized. The motivation for this change is that it can be useful to show which file is being tokenized when running the finetune example. Signed-off-by: Daniel Bevenius <[email protected]>
1 parent 3c4dd01 commit 5c33c63

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/finetune/finetune.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1799,7 +1799,7 @@ int main(int argc, char ** argv) {
17991799
std::vector<llama_token> train_tokens;
18001800
std::vector<size_t> train_samples_begin;
18011801
std::vector<size_t> train_samples_size;
1802-
printf("%s: tokenize training data\n", __func__);
1802+
printf("%s: tokenize training data from %s\n", __func__, params.common.fn_train_data);
18031803
tokenize_file(lctx,
18041804
params.common.fn_train_data,
18051805
params.common.sample_start,

0 commit comments

Comments
 (0)