Skip to content

Commit 03ffebc

Browse files
committed
fix: add chinese embedding model
1 parent 93342b4 commit 03ffebc

File tree

2 files changed

+3
-2
lines changed

2 files changed

+3
-2
lines changed

scrapegraphai/graphs/abstract_graph.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -320,7 +320,7 @@ def _create_embedder(self, embedder_config: dict) -> object:
320320
elif "azure" in embedder_params["model"]:
321321
return AzureOpenAIEmbeddings()
322322
elif "ollama" in embedder_params["model"]:
323-
embedder_params["model"] = embedder_params["model"].split("ollama/")[-1]
323+
embedder_params["model"] = "/".join(embedder_params["model"].split("/")[1:])
324324
try:
325325
models_tokens["ollama"][embedder_params["model"]]
326326
except KeyError as exc:

scrapegraphai/helpers/models_tokens.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -59,7 +59,8 @@
5959
"qwen:110b": 32000,
6060
"stablelm-zephyr": 8192,
6161
"wizardlm2:8x22b": 65536,
62-
# embedding models
62+
# embedding models
63+
"shaw/dmeta-embedding-zh": 8192,
6364
"snowflake-arctic-embed": 8192,
6465
"mxbai-embed-large": 512
6566
},

0 commit comments

Comments
 (0)