Skip to content

Commit 9a67a26

Browse files
committed
Update documentation
1 parent 8f1fbe7 commit 9a67a26

File tree

1 file changed

+2
-9
lines changed

1 file changed

+2
-9
lines changed

scrapegraphai/nodes/search_link_node.py

Lines changed: 2 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,6 @@
55
# Imports from standard library
66
from typing import List, Optional
77
from tqdm import tqdm
8-
from bs4 import BeautifulSoup
98

109

1110
# Imports from Langchain
@@ -19,15 +18,9 @@
1918

2019
class SearchLinkNode(BaseNode):
2120
"""
22-
A node that can filter out the relevant links in the webpage content.
23-
Node expects the aleready scrapped information and hence it is expected
21+
A node that can filter out the relevant links in the webpage content for the user prompt.
22+
Node expects the aleready scrapped links on the webpage and hence it is expected
2423
that this node be used after the FetchNode.
25-
26-
For the links which are not incomplete and hence in-navigable. the node will complete
27-
the url and return,
28-
29-
For example: link /projects/rotary-pendulum-rl/ on https://perinim.github.io/projects/,
30-
would be augmented to return https://perinim.github.io/projects/rotary-pendulum-rl/
3124
3225
Attributes:
3326
llm_model: An instance of the language model client used for generating answers.

0 commit comments

Comments
 (0)