Docs
View as Markdown

Commoncrawl

2 endpoints on Commoncrawl. Every one returns the same response shape and has a flat, published price in credits.

Category: Web tools · Overview page

Endpoints#

EndpointWhat it doesCostStatus
crawlsList Common Crawl crawl collections (id, name, date range, CDX API URL).1 creditstable
indexCommon Crawl index captures for a URL or domain in one crawl.5 creditsstable

Every endpoint page has a Field mapping section showing which source field becomes which unified field (fixed schema) or platform-specific ext. field.