Skip to content

Commit 13ae918

Browse files
docs: add diagram showing general structure/flow of the library
1 parent 3f0e069 commit 13ae918

File tree

3 files changed

+11
-0
lines changed

3 files changed

+11
-0
lines changed
50.5 KB
Binary file not shown.
74.4 KB
Loading

docs/source/introduction/overview.rst

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,3 +18,14 @@ Flexibility and Adaptability
1818
^^^^^^^^^^^^^^^^^^^^^^^^^^^
1919
Traditional web scraping tools often rely on fixed patterns or manual configuration to extract data from web pages. ScrapegraphAI, leveraging the power of LLMs, adapts to changes in website structures, reducing the need for constant developer intervention.
2020
This flexibility ensures that scrapers remain functional even when website layouts change.
21+
22+
23+
Overview
24+
========
25+
With ScrapegraphAI you first construct a pipeline of steps you want to execute by combining nodes into a graph.
26+
Executing the graph takes care of all the steps that are often part of scraping: fetching, parsing etc...
27+
Finally the scraped and processed data gets fed to an LLM which generates a response.
28+
29+
.. image:: ../../assets/project_overview_diagram.png
30+
:align: center
31+
:alt: ScrapegraphAI Overview

0 commit comments

Comments
 (0)