Skip to content

Commit ae164b4

Browse files
committed
Use external_deps for sentencepiece
as title Differential Revision: [D59770172](https://our.internmc.facebook.com/intern/diff/D59770172/) [ghstack-poisoned]
1 parent db09613 commit ae164b4

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

extension/llm/tokenizer/targets.bzl

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,8 +20,9 @@ def define_common_targets():
2020
"//bento_kernels/...",
2121
],
2222
_is_external_target = True,
23-
# TODO: Define an external_deps entry for sentencepiece instead of pointing to an fbsource path.
24-
deps = [] if runtime.is_oss else ["fbsource//third-party/pypi/sentencepiece:sentencepiece"],
23+
external_deps = [
24+
"sentencepiece-py",
25+
],
2526
)
2627

2728
runtime.python_binary(

0 commit comments

Comments
 (0)