Skip to content

Commit fdcfb90

Browse files
author
Guang Yang
committed
Fix circular import for lm_eval
1 parent 538575f commit fdcfb90

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

examples/models/llama/eval_llama_lib.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,6 @@
2020
Tokenizer as SentencePieceTokenizer,
2121
)
2222
from executorch.extension.llm.tokenizer.utils import get_tokenizer
23-
from lm_eval.api.model import LM
2423
from lm_eval.evaluator import simple_evaluate
2524

2625
from .evaluate.eager_eval import EagerEvalWrapper
@@ -159,7 +158,7 @@ def _model_call(self, inps):
159158
def gen_eval_wrapper(
160159
model_name: str,
161160
args: argparse.ArgumentParser,
162-
) -> LM:
161+
):
163162
"""
164163
Generates a wrapper interface around the provided model and tokenizer for
165164
the lm-evaluation-harness library.

0 commit comments

Comments
 (0)