Scrape API | Unified Agent APIs

Overview

Extract content from any URL as Markdown or HTML

Credits

Fast: 1, Standard: 2, Thorough: 5

Providers

FirecrawlAnchor

SDK Method

client.scrape(...)

Modes

The mode parameter is a preset that configures optimal provider routing for common use cases. You can also set individual parameters directly for fine-grained control.

Fast

1 credit

Raw HTTP, no JS. <1s.

Static HTML only.

Standard

2 credits

Full JS rendering. 2-5s.

SPAs, dynamic content.

Thorough

5 credits

Stealth browser + CAPTCHA. 10-30s.

Anti-bot sites.

Parameters

urlRequired

string

URL to scrape.

output

select (default: markdown)

Content format.

Markdown

HTML

Raw HTML

wait_for

string

CSS selector to wait for.

timeout

number (default: 30)

Max seconds.

Example Response

{
  "success": true,
  "data": {
    "content": "# Example Domain\n\nThis domain is for use in documentation examples.\n\n[Learn more](https://iana.org/domains/example)",
    "title": "Example Domain",
    "description": null,
    "links": [
      "https://iana.org/domains/example"
    ],
    "screenshot_url": null
  },
  "metadata": {
    "provider_used": "raw_http",
    "providers_tried": [
      "raw_http"
    ],
    "mode_used": "fast",
    "response_time_ms": 86,
    "request_id": "req_10632882"
  },
  "credits_used": 1
}

Get Started

Use this API through the O-mega platform. Create an API key in your dashboard, then call the endpoint with your key in the Authorization header.

Try Scrape

Test Scrape in the interactive playground. No setup required.

Open Playground