Skip to content

Commit 6a5622d

Browse files
committed
upgrade lm_eval to 0.4.5
[ghstack-poisoned]
1 parent 85d3ff6 commit 6a5622d

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

examples/models/llama/evaluate/eager_eval.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ def __init__(
3131
use_kv_cache: bool = False,
3232
):
3333
device = "cuda" if torch.cuda.is_available() else "cpu"
34-
super().__init__(device=device)
34+
super().__init__(device=device, pretrained="gpt2")
3535
self._model = model
3636
self._tokenizer = tokenizer
3737
self._device = torch.device(device)

examples/models/llama/install_requirements.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ pip install --no-use-pep517 "git+https://github.com/pytorch/ao.git@${TORCHAO_VER
1515

1616
# Install lm-eval for Model Evaluation with lm-evalution-harness
1717
# Install tiktoken for tokenizer
18-
pip install lm_eval==0.4.2
18+
pip install lm_eval==0.4.5
1919
pip install tiktoken blobfile
2020

2121
# Call the install helper for further setup

0 commit comments

Comments
 (0)