Skip to content

Commit f5e7a8b

Browse files
committed
fix of the bug for fetching the code
1 parent 94e69a0 commit f5e7a8b

File tree

2 files changed

+4
-4
lines changed

2 files changed

+4
-4
lines changed

examples/extras/scrape_do.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -31,8 +31,8 @@
3131
# ************************************************
3232

3333
smart_scraper_graph = SmartScraperGraph(
34-
prompt="List me what does the company do, the name and a contact email.",
35-
source="https://scrapegraphai.com/",
34+
prompt="List me all the projects",
35+
source="https://perinim.github.io/projects/",
3636
config=graph_config
3737
)
3838

scrapegraphai/nodes/fetch_node.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -288,8 +288,8 @@ def handle_web_source(self, state, source):
288288
data = scrape_do_fetch(self.scrape_do.get("api_key"),
289289
source)
290290

291-
document = [Document(page_content=content,
292-
metadata={"source": source}) for content in data]
291+
document = [Document(page_content=data,
292+
metadata={"source": source})]
293293
else:
294294
loader = ChromiumLoader([source], headless=self.headless, **loader_kwargs)
295295
document = loader.load()

0 commit comments

Comments
 (0)