The web data tool index

Independent ratings for 71 search APIs, extraction tools, and browser infrastructure platforms. Updated daily.

Browse directory

RSS feed|Email digest|

dev.to·ReleasesJust now

ScraperAPI Review 2026: Pricing, Features, and Honest Assessment - DEV Community

scrapfly.io·ReleasesJust now

How to Scrape LinkedIn in 2026 - Scrapfly Blog

aibusinesssites.com·LegalJust now

Is Web Scraping Legal? Key Rules Explained | AI Business Sites

serpapi.com·Releases3h ago

Build an AI Research Agent for Slack and Linear with SerpApi

rebrowser.net·Releases6h ago

MechanicalSoup: The Smart Developer's Guide to Python Web Scraping in 2025

nstbrowser.io·Releases6h ago

NewNstbrowser and Scrapeless Announce Strategic Integration, with Browser Labs R&D Center Launched

anchorbrowser.io·Releases6h ago

Technical DiveAug 28Anchor 🤝 Cloudflare - Verified Browser Agents

anchorbrowser.io·Research6h ago

Cloud Browsers: Why AI and Humans Need Different Infrastructure

anchorbrowser.io·Research6h ago

What Actually Drives Cost in Browser Automation?

anchorbrowser.io·Research6h ago

How AI Agents Interact With the Web: A Mental Model

browserless.io·Releases6h ago

Announcing BrowserQL, our next-gen automation tooling→

nimbleway.com·Funding6h ago

Announcing Our $47M Series B and the Nimble Web Search Agent Platform

View all 67 updates →Updated daily

How we evaluate

Same criteria, every tool. Each product is assessed on documentation quality, API design, reliability data, and pricing transparency. Affiliate relationships are disclosed and never influence placement or ratings.

For teams choosing infrastructure. Firecrawl or Tavily? Exa or Perplexity Sonar? We maintain assessments across the full landscape of tools connecting AI to the web, so you can evaluate options without running your own benchmarks.

Editor's picks

Featured tools

View all 71 tools →

Exa

Neural search engine using embeddings-based next-link prediction — finds semantically similar content, not just keyword matches.

FreemiumView details →

Tavily

Real-time search API purpose-built for AI agents and RAG pipelines, now owned by Nebius Group.

FreemiumView details →

Serper.dev

Fast, budget-friendly Google Search API at $1/1K queries — the go-to SERP API for AI startups and agent builders.

FreemiumView details →

DataForSEO

Comprehensive SEO data platform with SERP API plus 50+ additional APIs covering keywords, backlinks, and on-page data.

PaidView details →

Firecrawl

Converts websites to LLM-ready markdown via API, with crawling, extraction, search, and an agent endpoint — the Swiss Army knife of AI web data.

FreemiumView details →

Apify

Full-stack scraping platform with a marketplace of 10K+ pre-built scrapers (Actors), plus the open-source Crawlee framework.

FreemiumView details →

Directory

71 tools reviewed

AI-Native Search APIsFreemium

AI-Native Search APIsFreemium

Perplexity Sonar

AI-Native Search APIsPaid

AI-Native Search APIsPaid

AI-Native Search APIsPaid

AI-Native Search APIsFreemium

AI-Native Search APIsFreemium

AI-Native Search APIsFreemium

AI-Native Search APIsFreemium

AI-Native Search APIsFree

Writing

From the blog

Mar 15, 2026·6 min read

The AI search API landscape in 2026

A look at how AI-powered search APIs are reshaping the web scraping market, which players are leading, and what it means for teams evaluating infrastructure.

Mar 10, 2026·5 min read

Web scraping tools ranked by total funding

A breakdown of the most-funded web scraping companies, what they raised, and what the funding levels signal about the market.

Mar 5, 2026·6 min read

Comparing browser infrastructure for web scraping

Playwright vs Puppeteer vs Selenium vs cloud browser services — an objective comparison of browser automation options for scraping workloads.

Weekly briefing

Tool launches, funding rounds, pricing changes, and market data. Every Tuesday.