Better Fetch

Cheerio Scraper

Scrape one raw HTML page over HTTP into structured metadata, readable text, links, images, JSON-LD types, response metadata, and optional simple selector matches.

Developer Toolsv0.1.1~1 credit/runSource on GitHub

Workspace

Configure

Inputs stay here while results become exportable artifacts.

Start from an example

The public http(s) page URL to scrape over raw HTTP.

Maximum links to return.

Optional simple selectors to extract text from, e.g. h1, main, article, .price, #content. One item per line.

Maximum images to return.

Maximum readable text characters to return.

Sign in and run
~1 base credit/run10 runs/minute

Results

Preview, inspect, copy, or export the complete output.

Your result will become an artifact

Run the tool to inspect structured rows, raw JSON, execution details, and downloadable JSON, CSV, and Markdown files.

urltextlinkstitleimagesstatusfinal_urlhtml_bytes

Overview

Cheerio Scraper is the fast HTTP-first extractor in the Better Fetch marketplace. Provide a public URL and the tool retrieves the raw response without launching a browser, then normalizes page metadata, readable text, link and image inventories, JSON-LD types, content type, status, byte size, and lightweight selector matches.

Last validated: Aug 9, 2026

Input

urlstring (uri)required

The public http(s) page URL to scrape over raw HTTP.

max_linksintegerdefault: 25

Maximum links to return.

selectorsstring[]

Optional simple selectors to extract text from, e.g. h1, main, article, .price, #content.

max_imagesintegerdefault: 10

Maximum images to return.

max_text_charsintegerdefault: 12000

Maximum readable text characters to return.

Output

urlstringrequired

Requested URL

textstringrequired

Readable page text

linksobject[]

Links discovered in page order

titlestringrequired

Page title

imagesobject[]

Images discovered in page order

statusinteger

HTTP status code returned by Better Fetch

final_urlstringrequired

Final URL after redirects

html_bytesinteger

Raw HTML byte length

word_countintegerrequired

Words in extracted text

descriptionstring

Meta description

content_typestring

Response Content-Type header when available

canonical_urlstring

Canonical page URL

json_ld_typesstring[]

Structured data @type values

selector_resultsobject[]

Optional selector text matches

Examples

example-page

{
  "url": "https://example.com",
  "max_links": 10,
  "selectors": [
    "h1",
    "p"
  ],
  "max_images": 5,
  "max_text_chars": 2000
}

Use cases

Fast HTML extraction

Collect titles, descriptions, canonical URLs, readable text, links, and images from static pages without paying the browser-rendering cost.

Crawler building blocks

Use the raw HTTP response fields, link inventory, and content-type metadata as a first pass before building a deeper domain-specific crawler.

Agent page inspection

Give an agent clean static-page data for documentation pages, blogs, product pages, and directories that do not require JavaScript rendering.

FAQ

How is Cheerio Scraper different from Web Scraper?

Cheerio Scraper uses raw HTTP and is faster for static HTML pages. Web Scraper uses the browser path and is better for pages that need client-side JavaScript rendering.

Does this version crawl recursively?

No. Version 0.1 focuses on one page per run. Recursive queues, glob filters, pseudo-URLs, and enqueue behavior should be added as separately validated slices.

Can it run arbitrary page functions?

No. It returns a fixed, safe structured extraction. Custom Node page functions are intentionally out of scope for this first marketplace version.

Use it anywhere

MCP (Claude, ChatGPT, Codex)

# After connecting https://betterfetch.co/api/mcp, ask your AI to:
1. Call search_tools for "Cheerio Scraper"
2. Call run_tool with:
   name: "cheerio_scraper"
   input: {"url":"https://example.com","max_links":10,"selectors":["h1","p"],"max_images":5,"max_text_chars":2000}

REST

curl -sS -X POST "https://betterfetch.co/api/tools/cheerio_scraper/run" \
  -H "Authorization: Bearer bf_your_key_here" \
  -H "Content-Type: application/json" \
  -d '{"input": {"url":"https://example.com","max_links":10,"selectors":["h1","p"],"max_images":5,"max_text_chars":2000}}'

Run locally

git clone https://github.com/better-fetch/tools/tree/main/tools/cheerio-scraper && cd cheerio-scraper && npm i
BETTER_FETCH_API_KEY=bf_your_key_here npx bf-tool run --input '{"url":"https://example.com","max_links":10,"selectors":["h1","p"],"max_images":5,"max_text_chars":2000}'