|
| 1 | +# π ScrapeGraph AI SDKs |
| 2 | + |
| 3 | +[](https://opensource.org/licenses/MIT) |
| 4 | +[](https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-py) |
| 5 | +[](https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-js) |
| 6 | +[](https://scrapegraphai.com/docs) |
| 7 | + |
| 8 | +Official SDKs for the ScrapeGraph AI API - Intelligent web scraping powered by AI. Extract structured data from any webpage with natural language prompts. |
| 9 | + |
| 10 | +## π Quick Links |
| 11 | + |
| 12 | +- [Python SDK Documentation](scrapegraph-py/README.md) |
| 13 | +- [JavaScript SDK Documentation](scrapegraph-js/README.md) |
| 14 | +- [API Documentation](https://scrapegraphai.com/docs) |
| 15 | +- [Website](https://scrapegraphai.com) |
| 16 | + |
| 17 | +## π¦ Installation |
| 18 | + |
| 19 | +### Python |
| 20 | +```bash |
| 21 | +pip install scrapegraph-py |
| 22 | +``` |
| 23 | + |
| 24 | +### JavaScript |
| 25 | +```bash |
| 26 | +npm install scrapegraph-js |
| 27 | +``` |
| 28 | + |
| 29 | +## π― Core Features |
| 30 | + |
| 31 | +- π€ **AI-Powered Extraction**: Use natural language to describe what data you want |
| 32 | +- π **Structured Output**: Get clean, structured data with optional schema validation |
| 33 | +- π **Multiple Formats**: Extract data as JSON, Markdown, or custom schemas |
| 34 | +- β‘ **High Performance**: Concurrent processing and automatic retries |
| 35 | +- π **Enterprise Ready**: Production-grade security and rate limiting |
| 36 | + |
| 37 | +## π οΈ Available Endpoints |
| 38 | + |
| 39 | +### π SmartScraper |
| 40 | +Extract structured data from any webpage using natural language prompts. |
| 41 | + |
| 42 | +### π Markdownify |
| 43 | +Convert any webpage into clean, formatted markdown. |
| 44 | + |
| 45 | +### π» LocalScraper |
| 46 | +Extract information from a local HTML file using AI. |
| 47 | + |
| 48 | + |
| 49 | +## π Key Benefits |
| 50 | + |
| 51 | +- π **Natural Language Queries**: No complex selectors or XPath needed |
| 52 | +- π― **Precise Extraction**: AI understands context and structure |
| 53 | +- π **Adaptive Scraping**: Works with dynamic and static content |
| 54 | +- π **Schema Validation**: Ensure data consistency with Pydantic/TypeScript |
| 55 | +- β‘ **Async Support**: Handle multiple requests efficiently |
| 56 | + |
| 57 | +## π‘ Use Cases |
| 58 | + |
| 59 | +- π’ **Business Intelligence**: Extract company information and contacts |
| 60 | +- π **Market Research**: Gather product data and pricing |
| 61 | +- π° **Content Aggregation**: Convert articles to structured formats |
| 62 | +- π **Data Mining**: Extract specific information from multiple sources |
| 63 | +- π± **App Integration**: Feed clean data into your applications |
| 64 | + |
| 65 | +## π Documentation |
| 66 | + |
| 67 | +For detailed documentation and examples, visit: |
| 68 | +- [Python SDK Guide](scrapegraph-py/README.md) |
| 69 | +- [JavaScript SDK Guide](scrapegraph-js/README.md) |
| 70 | +- [API Documentation](https://scrapegraphai.com/docs) |
| 71 | + |
| 72 | +## π¬ Support & Feedback |
| 73 | + |
| 74 | + |
| 75 | +- π» GitHub Issues: [Create an issue](https://github.com/ScrapeGraphAI/scrapegraph-sdk/issues) |
| 76 | +- π Feature Requests: [Request a feature](https://github.com/ScrapeGraphAI/scrapegraph-sdk/issues/new) |
| 77 | + |
| 78 | +## π License |
| 79 | + |
| 80 | +This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details. |
| 81 | + |
| 82 | +--- |
| 83 | + |
| 84 | +Made with β€οΈ by [ScrapeGraph AI](https://scrapegraphai.com) |
0 commit comments