Web Scraper

skl_24e4b780-730d-5114-9539-9403ce5f4613

sandbase/web-scraper

Scrape web pages, crawl sites, extract structured data, and capture screenshots through SandBase. Use when asked to extract content from URLs, crawl websites, get structured data from pages, take screenshots, or convert web pages to markdown.

Default version
1
Availability
Public

Install Skill

NPX

npx -y skills add https://github.com/sandbaseai/sandbase-skills/tree/main/research/web-scraper
  • SandBase Agent: Supported
  • Codex: Supported
  • Claude: Supported
  • Cursor: Supported

Tools & Endpoints

7 API endpoints

Dependencies declared by this Skill. Configure the MCP connection in your Agent separately.

API endpoints

  1. context_dev_scrape_markdown
  2. context_dev_capture_screenshot
  3. context_dev_extract_structured_data
  4. context_dev_extract_product
  5. firecrawl_scrape
  6. firecrawl_crawl
  7. firecrawl_map

MCP services

  1. sandbase-mcp

About this Skill

Scrape web pages, crawl sites, extract structured data, and capture screenshots through SandBase. Use when asked to extract content from URLs, crawl websites, get structured data from pages, take screenshots, or convert web pages to markdown.

Use it in an Agent

Select this public Skill or an organization Skill when configuring an Agent. Each saved Agent version pins the selected Skill version.

Questions about this Skill.

What does this Skill need to run?

An agent connected to SandBase. Web Scraper declares 7 SandBase API endpoints; your agent calls them through the MCP connection you configure, and the calls are billed to your SandBase organization.

Which agents can use it?

The Skill declares support for SandBase Agent, Codex, Claude, Cursor. Install it with the NPX command on this page, or select it when configuring a SandBase Agent.

Can I run it on this page?

No. API Skills run in your own agent with your SandBase account. This page shows what the Skill declares and how to install it.

More Skills

Screenshot Capture

Capture high-quality screenshots of any public URL at custom resolutions. Supports desktop and mobile viewports, full-page captures, and specific element targeting. Ideal for visual monitoring, design research, and content archival.

Tech Stack Detector

Identify the technology stack powering any website — frameworks, CMS, analytics, hosting, CDN, payment processors, and marketing tools. Useful for competitive intelligence, sales prospecting, and technology landscape research.

URL to Markdown

Convert any public web page into clean, structured Markdown. Preserves headings, links, images, code blocks, and tables while removing ads, navigation, and clutter. Perfect for content archival, knowledge base building, and research note-taking.

All Data processing Skills