Skip to content

Commit 3b9ec9b

Browse files
authored
Merge pull request #220 from daniele-roncaglioni/102-library-overview-diagram
docs: add diagram showing general structure/flow of the library
2 parents d8ed76b + b441b30 commit 3b9ec9b

File tree

3 files changed

+11
-0
lines changed

3 files changed

+11
-0
lines changed
51.8 KB
Binary file not shown.
82 KB
Loading

docs/source/introduction/overview.rst

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,3 +18,14 @@ Flexibility and Adaptability
1818
^^^^^^^^^^^^^^^^^^^^^^^^^^^
1919
Traditional web scraping tools often rely on fixed patterns or manual configuration to extract data from web pages. ScrapegraphAI, leveraging the power of LLMs, adapts to changes in website structures, reducing the need for constant developer intervention.
2020
This flexibility ensures that scrapers remain functional even when website layouts change.
21+
22+
23+
Overview
24+
========
25+
With ScrapegraphAI you first construct a pipeline of steps you want to execute by combining nodes into a graph.
26+
Executing the graph takes care of all the steps that are often part of scraping: fetching, parsing etc...
27+
Finally the scraped and processed data gets fed to an LLM which generates a response.
28+
29+
.. image:: ../../assets/project_overview_diagram.png
30+
:align: center
31+
:alt: ScrapegraphAI Overview

0 commit comments

Comments
 (0)