Skip to content

Commit 601f2d1

Browse files
Jack-Khuuvmpuri
authored andcommitted
Update import of sdpa_with_kv_cache to custom_ops (#1470)
1 parent ef58fce commit 601f2d1

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

torchchat/model.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1025,7 +1025,7 @@ def apply_rotary_emb(x: Tensor, freqs_cis: Tensor) -> Tensor:
10251025
# For quantized_decomposed ops
10261026
from executorch.kernels import quantized # no-qa
10271027
# For llama::sdpa_with_kv_cache.out, preprocess ops
1028-
from executorch.extension.llm.custom_ops import sdpa_with_kv_cache # no-qa
1028+
from executorch.extension.llm.custom_ops import custom_ops # no-qa
10291029

10301030
class PTEModel(nn.Module):
10311031
def __init__(self, config, path) -> None:

0 commit comments

Comments
 (0)