Docs
View as Markdown

Web

25 endpoints on Web. Every one returns the same response shape and has a flat, published price in credits.

Category: Web tools · Overview page

Endpoints#

EndpointWhat it doesCostStatus
articleArticle extraction: title, byline, date, markdown and plain text, reading time.5 creditsstable
contactsPublic contact points on a page: emails, phone numbers, social profile links.3 creditsstable
extractStructured data extracted from a web page by instruction (JSON object).12 creditsbeta needs a pack
faviconBest favicon/app icon of a site plus every declared icon.2 creditsstable
feedParse an RSS 2.0/RSS 1.0/Atom/JSON Feed URL into normalized items.3 creditsstable
feedsDiscover RSS/Atom/JSON feeds advertised by a page.2 creditsstable
headersHTTP status, response headers (cookie values redacted) and redirect chain of a URL.2 creditsstable
headingsHeading outline (h1-h6) of a page.2 creditsstable
imagesImages on a page (img, srcset, picture, og:image) with alt text and dimensions.3 creditsstable
jsonldJSON-LD structured data blocks (schema.org) of a page.3 creditsstable
linksAll links on a page with anchor text, internal/external and nofollow flags.3 creditsstable
markdownMain content of a page as clean markdown (readability-style).2 creditsstable
metadataPage metadata: title, description, canonical, language, OpenGraph, Twitter cards, favicon.2 creditsstable
microdataHTML microdata (itemscope/itemprop) items of a page.3 creditsstable
opengraphOpenGraph and Twitter card tags of a page.2 creditsstable
redirectsRedirect chain of a URL, hop by hop (status and Location).2 creditsstable
robotsParse a site's robots.txt: groups, allow/disallow rules, crawl-delay, sitemaps.1 creditstable
security_headersSecurity header audit (HSTS, CSP, X-Frame-Options, ...) with score and grade.2 creditsstable
sitemapParse an XML/gzip/text sitemap or sitemap index into URL entries.2 creditsstable
social_linksSocial network profile links found on a page.2 creditsstable
ssl_certTLS certificate of a host: issuer, validity window, SANs, protocol, verification result.2 creditsstable
tablesHTML tables of a page as headers + rows.3 creditsstable
techstackTechnology detection from response headers, meta tags, scripts and markup (CMS, framework, CDN, analytics).3 creditsstable
textMain content of a page as plain text (readability-style).5 creditsstable
unlocked_markdownMarkdown of a page that is hard to reach from ordinary servers.8 creditsbeta needs a pack

Every endpoint page has a Field mapping section showing which source field becomes which unified field (fixed schema) or platform-specific ext. field.