Skip to content

Commit ed1c708

Browse files
fix: change of "sentence" behaviour in DocumentSplitter (#373)
* adding fix * adding fix * adding fix * fix splitter * install nltk * add nltk dep to index.toml * Trigger Build * Trigger Build --------- Co-authored-by: anakin87 <[email protected]>
1 parent bed7bfc commit ed1c708

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tutorials/39_Embedding_Metadata_for_Improved_Retrieval.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -182,7 +182,7 @@
182182
"\n",
183183
"def create_indexing_pipeline(document_store, metadata_fields_to_embed=None):\n",
184184
" document_cleaner = DocumentCleaner()\n",
185-
" document_splitter = DocumentSplitter(split_by=\"sentence\", split_length=2)\n",
185+
" document_splitter = DocumentSplitter(split_by=\"period\", split_length=2)\n",
186186
" document_embedder = SentenceTransformersDocumentEmbedder(\n",
187187
" model=\"thenlper/gte-large\", meta_fields_to_embed=metadata_fields_to_embed\n",
188188
" )\n",

0 commit comments

Comments
 (0)