Web scraping tools with markdown output

You.com

Composable web, news, and research search APIs for enterprise agents

Jina AI

Reader API that turns any URL into clean markdown, now part of Elastic

Seltz

Web knowledge API running its own Rust crawler and hybrid index

Valyu

Search API spanning the web plus arXiv, PubMed, and SEC filings

DeepSeek Search API

DeepSeek's own search engine, sold as a $0.75-per-1k API

browserfoundry

Search, deep search and cloud browsers behind one API key

Firecrawl

Turns any website into LLM-ready markdown via a single API

AnakinScraper

Extracts structured JSON with prebuilt, agent-ready site actions

Webclaw

Rust page-to-markdown API with raw-HTTP-first browser-fallback engine

Tabstack

Mozilla's web execution API routing from raw fetch to full browser

Context.dev

URL-to-markdown API with an added brand-data layer for agents

Scrape.do

Unblocking scraper API with markdown output and Google plugins

Crawlbase

Long-running crawling API with markdown mode and an MCP server

Upscrape

Platform data endpoints an agent can search, price, and run over MCP

Crawl4AI

Open-source crawler shaped for RAG, among the most-starred on GitHub

Trafilatura

Strips nav, ads, and chrome to leave the main article text