Scrapegraph-ai
Python scraper based on AI
Python scraper based on AI
Search engines, scrapers, and data infrastructure for AI pipelines.
Key features
- 自然语言描述要抓什么
- LLM+图逻辑构建流水线
- 支持网站与本地文档
- 集成 LangChain 等框架
- 提供 MCP 服务器
- 多语言文档
Good for
- 网页数据提取
- 文档信息抽取
- 竞品数据监控
- RAG 数据采集
Stack & tags
PythonLangChainLlamaIndexMCPPyPIai-crawlerai-scrapingai-searchcrawlerdata-extractionfirecrawl-alternativelarge-language-modelllm
Quick start
pip install scrapegraphaiFrom the project README on GitHub.