Skip to content

Commit 56aa9ef

Browse files
committed
Update naming for sdpa to custom ops
1 parent d85657c commit 56aa9ef

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

torchchat/export.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -222,7 +222,7 @@ def forward(self, x, freqs_cis, mask, input_pos=None, cache_lane: int = 0):
222222
return self.wo(output)
223223

224224
def replace_attention_with_custom_sdpa_attention(module: nn.Module):
225-
from executorch.extension.llm.custom_ops import sdpa_with_kv_cache # noqa
225+
from executorch.extension.llm.custom_ops import custom_ops # noqa
226226

227227
for name, child in module.named_children():
228228
if isinstance(child, Attention):

0 commit comments

Comments
 (0)