web.text

curl "https://api.onekey.dev/v1/web/text?url=https%3A%2F%2Fen.wikipedia.org%2Fwiki%2FWeb_scraping" \
  -H "x-api-key: YOUR_API_KEY"

{
  "success": true,
  "data": {
    "content": {
      "title": "Web scraping - Wikipedia",
      "text": "Web scraping\n\nFrom Wikipedia, the free encyclopedia\n\nFor broader coverage of this topic, see Data scraping.\n\n\"Web scraper\" redirects here. For websites that scrape content, see Scraper site.\n\n\tThis article needs more citations. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: \"Web scraping\" – news · newspapers · books · scholar · JSTOR (April 2023) (Learn how and when to remove this message)\n\nWeb scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites.[1] Web scraping software may directly access the World Wide Web using the Hypertext Transfer Protocol or a web browser. While web scraping can be done manually by a software user, the term typically refers to automated processes implemented using a bot or web crawler. It is a form of copying in which specific data is gathered and copied from the web, typically into a central local database or spreadsheet, for later retrieval or analysis.\n\nScraping a web page involves fetching it and then extracting data from it. Fetching is the downloading of a page (which a browser does when a user views a page). Therefore, web crawling is a main component of web scraping, to fetch pages for later processing. Having fetched, extraction can take place. The content of a page may be parsed, searched and reformatted, and its data copied into a spreadsheet or loaded into a database. Web scrapers typically take something out of a page, to make use of it for another purpose somewhere else. An example would be finding and copying names and telephone numbers, companies and their URLs, or e-mail addresses to a list (contact scraping). Another example is collecting competitors product prices for marketing purposes, which can involve gathering large-scale pricing datasets from e-commerce websites and analysing them using data science techniques such as trend analysis, predictive modelling, and competitive benchmarking.\n\nContact scraping is a type of web scraping that is used as a component of applications used for web indexing, web mining and data mining, online price change monitoring and price comparison, product review scraping (to watch the competition), gathering real estate listings, weather data monitoring, website change detection, research, tracking online presence and reputation, web mashup, and web data integration.\n\nWeb pages are built using text-based markup languages (HTML and XHTML), and frequently contain a wealth of data in text form. However, most web pages are designed for human end-users and not for ease of automated use. As a result, specialized tools and software have been developed to facilitate the scraping of web pages. Web scraping applications include market research, price comparison, content monitoring and artificial intelligence. Businesses rely on web scraping services to efficiently gather and use this data.\n\nThere are methods that some websites use to prevent",
      "url": "https://en.wikipedia.org/wiki/Web_scraping",
      "language": "en",
      "createdAt": "2005-09-17T18:57:30Z"
    },
    "author": {
      "displayName": "Contributors to Wikimedia projects"
    },
    "entity": {
      "name": null
    },
    "ext": {
      "wordCount": 4414,
      "readingTimeMinutes": 21,
      "excerpt": "Web scraping From Wikipedia, the free encyclopedia For broader coverage of this topic, see Data scraping. \"Web scraper\" redirects here. For websites that scrape content, see Scraper site. This article needs more citations. Please help improve this article by adding citations to reliable sources. Uns"
    },
    "media": {
      "url": null
    }
  },
  "metadata": {
    "platform": "web",
    "endpoint": "text",
    "cached": false,
    "stale": false,
    "age_s": 0,
    "fetched_at": "2026-01-01T12:00:00+00:00",
    "credits_charged": 5,
    "request_id": "7f3a9c2e5b1d4c8fa2e6d0b9c4f18e37"
  },
  "error": null
}