Firecrawl Crawl

API docs
https://api.sandbase.ai/v1/api/firecrawl/crawl

Crawl an entire website starting from a URL. Discovers and scrapes all reachable pages, returning clean markdown for each. Runs asynchronously — submit the job, then poll for results.

Price
From $0.0075USD / call
Method
POST
Response
Async JSON
Parameters
2 required · 1 optional

Playground

Input
The starting URL to crawl.
Maximum number of pages to crawl. Range: 1 to 10000.
Options passed to the scraper for each page.
OutputReady

Your output will appear here

Complete the inputs, then click Run.

API README

Firecrawl Crawl API

Crawls a website from a starting URL and returns the content of each page it finds as markdown, plus page metadata. It needs a url and a limit for the maximum number of pages. The job runs asynchronously, so you submit it and then poll for the result.

Use cases

  • Copy the pages of a documentation site into markdown files for a search index or an LLM knowledge base.
  • Pull the text of a company site to summarize its products and pricing pages.
  • Snapshot a site's content on a schedule so you can compare versions over time.
  • Collect page text from a small site to check language and content type across all its pages.

Request

curl -X POST "https://api.sandbase.ai/v1/api/firecrawl/crawl" \
  -H "Authorization: Bearer $SANDBASE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://example.com", "limit": 2}'

The result is returned in outputs[0].data.

Parameters

NameTypeRequiredDescription
limitintegerYesMaximum number of pages to crawl.
urlstringYesThe starting URL to crawl.
scrapeOptionsobjectNoOptions passed to the scraper for each page.

Example response

Real response for the request above, trimmed: lists keep their first item and long strings are cut.

{
  "completed": 2,
  "completedAt": "2026-11-03T07:33:32.633Z",
  "createdAt": "2026-11-03T07:33:31.620Z",
  "creditsUsed": 2,
  "data": [
    {
      "markdown": "This domain is for use in documentation examples without needing permission. Thi…",
      "metadata": {
        "cacheState": "hit",
        "cachedAt": "2026-11-03T07:33:19.669Z",
        "contentType": "text/html; charset=utf-8",
        "creditsUsed": 1,
        "favicon": "data:,",
        "language": "en",
        "proxyUsed": "basic",
        "scrapeId": "01a1a053-d857-759b-8946-800c1acf51cf"
      },
      "warning": "This scrape job was throttled at your current concurrency limit. If you'd like t…"
    }
  ],
  "duration": 1.013,
  "expiresAt": "2026-11-04T07:33:41.000Z",
  "status": "completed",
  "success": true,
  "total": 2
}

Response fields

FieldMeaning
status / successstatus shows the job state, such as completed. success is a boolean for the request.
total / completedtotal is the number of pages found for the job. completed is the number of pages finished so far.
data[].markdownThe page content converted to markdown.
data[].metadata.language / data[].metadata.contentTypeThe page language code (for example en) and the content type of the response (for example text/html; charset=utf-8).
data[].metadata.scrapeIdAn ID for the scrape of that single page.
data[].metadata.cacheState / data[].metadata.cachedAtcacheState shows whether the page came from a cache (for example hit). cachedAt is the ISO timestamp of the cached copy.
data[].metadata.creditsUsed / creditsUsedCredits used for one page and for the whole job.
data[].warningAn optional message on a page, such as a note that the scrape was throttled. It appears only on some items.
createdAt / completedAt / expiresAtISO 8601 UTC timestamps for when the job started, when it finished, and when the result expires.
durationHow long the job took. The value in the example is 1.013.

Notes

  • Poll GET /v1/run/{id} until status is completed, then read the result from outputs[0].data.
  • Set limit between 1 and 10000 to cap the number of pages crawled.
  • Set scrapeOptions.formats to choose the output formats: markdown, html, rawHtml, links or screenshot.
  • To scrape one known page, use Firecrawl Page Scraper. To list a site's URLs without content, use Firecrawl URL Discovery.

Pricing

Billed at the actual cost of each call, about $0.0075 for the request above. Failed calls are not charged.

Explore more

Related APIs

All APIs
APIPriceResponse
FirecrawlFrom $0.0075 per callAsync JSON
FirecrawlFrom $0.0075 per callAsync JSON
Firecrawl$0.0075 per callJSON
Firecrawl$0.0075 per callJSON
Firecrawl$0.015 per callJSON

Questions

FAQ

How do I use the Firecrawl Crawl API?

Send a POST request to https://api.sandbase.ai/v1/api/firecrawl/crawl with your SandBase API key in the Authorization header (Bearer) and the parameters as a JSON body. You can also try it in the Playground on this page without writing code.

How much does the Firecrawl Crawl API cost?

From $0.0075 per call, billed from your SandBase balance. You are only charged for calls you make; there is no subscription.

What parameters does the Firecrawl Crawl API accept?

Required: url (string) and limit (integer). Optional: scrapeOptions (object). The Parameters table and the Playground on this page list every field.

What does the Firecrawl Crawl API return?

A JSON result. This endpoint runs asynchronously, so the response tells you how to fetch the finished result. The README on this page includes a sample response.

Do I need a Firecrawl developer account or API key?

No. Firecrawl Crawl runs through SandBase, so one SandBase API key covers this endpoint and every other API and model in the catalog. You do not need to apply for Firecrawl API access separately.