File tree Expand file tree Collapse file tree 1 file changed +2
-9
lines changed Expand file tree Collapse file tree 1 file changed +2
-9
lines changed Original file line number Diff line number Diff line change 5
5
# Imports from standard library
6
6
from typing import List , Optional
7
7
from tqdm import tqdm
8
- from bs4 import BeautifulSoup
9
8
10
9
11
10
# Imports from Langchain
19
18
20
19
class SearchLinkNode (BaseNode ):
21
20
"""
22
- A node that can filter out the relevant links in the webpage content.
23
- Node expects the aleready scrapped information and hence it is expected
21
+ A node that can filter out the relevant links in the webpage content for the user prompt .
22
+ Node expects the aleready scrapped links on the webpage and hence it is expected
24
23
that this node be used after the FetchNode.
25
-
26
- For the links which are not incomplete and hence in-navigable. the node will complete
27
- the url and return,
28
-
29
- For example: link /projects/rotary-pendulum-rl/ on https://perinim.github.io/projects/,
30
- would be augmented to return https://perinim.github.io/projects/rotary-pendulum-rl/
31
24
32
25
Attributes:
33
26
llm_model: An instance of the language model client used for generating answers.
You can’t perform that action at this time.
0 commit comments