web-reader-api
WebReader API is a high-performance scraping tool designed specifically for AI agents and RAG (Retrieval-Augmented Generation) workflows. It transforms any web page into clean, structured Markdown, stripping away ads, navigation, and clutter to save you up to 80% on LLM token costs. 🌟 Why Choose WebReader API? Superior Japanese Support: Unlike many global scrapers, we handle complex Japanese…
web-reader-api endpoints
| Method | Endpoint | Description |
|---|---|---|
| POST |
batchRead /api/batch |
|
| GET |
getCrawlStatus /v1/crawl/{id} |
|
| POST |
scrapeUrl /v1/scrape |
Firecrawl-compatible scraping. Drop-in replacement for LangChain FireCrawlLoader. |
| POST |
sitemapCrawl /api/sitemap |
|
| GET |
readUrl /api/read |
|
| POST |
mapUrls /v1/map |
|
| GET |
healthCheck /health |
|
| GET |
readUrlMarkdown /api/markdown |
|
| POST |
startCrawl /v1/crawl |