Web pages API

Get Web pages data as clean JSON with one key: 25 endpoints, 1 to 12 credits per call, the same response shape as every other platform.

What you get#

Onekey exposes Web pages as 25 endpoints behind one API key: 13 endpoints return one record (data is an object) and 12 endpoints return a list (data is an array). Every answer uses the same envelope (success, data, metadata, error), the cost is reported in metadata.credits_charged, and fields are mapped onto the unified schema so the code you write for Web pages also works for the rest of the web tools category.

Endpoints#

EndpointWhat it doesParametersCreditsStatus
articleArticle extraction: title, byline, date, markdown and plain text, reading time.url*5stable
contactsPublic contact points on a page: emails, phone numbers, social profile links.url*3stable
extractStructured data extracted from a web page by instruction (JSON object).url*, prompt*12beta needs a pack
faviconBest favicon/app icon of a site plus every declared icon.url*2stable
feedParse an RSS 2.0/RSS 1.0/Atom/JSON Feed URL into normalized items.url*3stable
feedsDiscover RSS/Atom/JSON feeds advertised by a page.url*2stable
headersHTTP status, response headers (cookie values redacted) and redirect chain of a URL.url*2stable
headingsHeading outline (h1-h6) of a page.url*2stable
imagesImages on a page (img, srcset, picture, og:image) with alt text and dimensions.url*3stable
jsonldJSON-LD structured data blocks (schema.org) of a page.url*3stable
linksAll links on a page with anchor text, internal/external and nofollow flags.url*3stable
markdownMain content of a page as clean markdown (readability-style).url*2stable
metadataPage metadata: title, description, canonical, language, OpenGraph, Twitter cards, favicon.url*2stable
microdataHTML microdata (itemscope/itemprop) items of a page.url*3stable
opengraphOpenGraph and Twitter card tags of a page.url*2stable
redirectsRedirect chain of a URL, hop by hop (status and Location).url*2stable
robotsParse a site's robots.txt: groups, allow/disallow rules, crawl-delay, sitemaps.url*1stable
security_headersSecurity header audit (HSTS, CSP, X-Frame-Options, ...) with score and grade.url*2stable
sitemapParse an XML/gzip/text sitemap or sitemap index into URL entries.url*2stable
social_linksSocial network profile links found on a page.url*2stable
ssl_certTLS certificate of a host: issuer, validity window, SANs, protocol, verification result.url*2stable
tablesHTML tables of a page as headers + rows.url*3stable
techstackTechnology detection from response headers, meta tags, scripts and markup (CMS, framework, CDN, analytics).url*3stable
textMain content of a page as plain text (readability-style).url*5stable
unlocked_markdownMarkdown of a page that is hard to reach from ordinary servers.url*8beta needs a pack

A * marks a required parameter. Each endpoint name links to its reference page with the full parameter table, caching window and a recorded response.

Make a request#

This calls web.robots (1 credit, stable). Replace YOUR_API_KEY with your key; sign up, no card. 1,000 free credits cover the open-platform endpoints. Hard-to-reach platforms (X, TikTok, Instagram, Reddit, and others marked on their page) need a verified email and a purchased pack.

curl "https://api.onekey.dev/v1/web/robots?url=https%3A%2F%2Fwww.python.org%2F" \
  -H "x-api-key: YOUR_API_KEY"

Fields you get back#

These unified fields come back from Web pages, with the same names as on every other platform. The count is how many of its 25 mapped endpoints return the field; a field the source lacks is null, never missing. 82 platform-specific fields (ext.<name>) come on top, documented on each endpoint page.

FieldTypeEndpoints
content.urlURL13
content.titlestring12
content.textstring9
entity.namestring9
media.urlURL8
content.createdAtISO 8601 date6
content.languagestring6
entity.urlURL6
author.displayNamestring5
entity.typestring5
entity.tagslist of strings2
entity.updatedAtISO 8601 date2
author.usernamestring1
content.idstring1
entity.categorystring1
entity.locationstring1
entity.stats.scorenumber1

The full schema is in Unified schema.

Pricing#

Web pages calls cost 1 to 12 credits, flat per endpoint. Free when served from cache (0.2 credit for a cached response over 100 KB). Invalid, failed or not-found calls are not charged. See pricing for credit packs.