Skip to content

Commit 4a627d4

Browse files
guangy10Guang Yang
andauthored
Fix circular import for lm_eval (#6572)
Co-authored-by: Guang Yang <[email protected]>
1 parent 538575f commit 4a627d4

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

examples/models/llama/eval_llama_lib.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,6 @@
2020
Tokenizer as SentencePieceTokenizer,
2121
)
2222
from executorch.extension.llm.tokenizer.utils import get_tokenizer
23-
from lm_eval.api.model import LM
2423
from lm_eval.evaluator import simple_evaluate
2524

2625
from .evaluate.eager_eval import EagerEvalWrapper
@@ -159,7 +158,7 @@ def _model_call(self, inps):
159158
def gen_eval_wrapper(
160159
model_name: str,
161160
args: argparse.ArgumentParser,
162-
) -> LM:
161+
):
163162
"""
164163
Generates a wrapper interface around the provided model and tokenizer for
165164
the lm-evaluation-harness library.

0 commit comments

Comments
 (0)