PlugWiki

firecrawl-crawl Skill: Pull Every Page From a Site Section

Makes your coding assistant crawl a website or one section of it with Firecrawl and save the pages it finds.

Installs
81K
on skills.sh
Stars
676
on GitHub
Updated
Oct 2026
last repo commit

firecrawl-crawl teaches your assistant to run firecrawl crawl <url>. A crawl follows links from a start page up to a depth or page limit and saves the content. The skill tells the assistant to scope crawls with --include-paths whenever you name a section.

You must install the Firecrawl CLI and sign in, because crawl has no keyless free tier. A crawl uses credits per page, so check usage first.

Good for

  • Developers who want a whole docs section loaded for a coding task
  • Researchers who need content that spans many linked pages
  • Teams building a knowledge base from a site

Install firecrawl-crawl

Claude Code

  1. 1

    Copy this prompt.

    Install the firecrawl-crawl skill in Claude Code. Run this command:
    
    npm install -g firecrawl-cli@latest
    firecrawl login --browser
    npx skills add https://github.com/firecrawl/cli --skill firecrawl-crawl -a claude-code
    
    Then check that it loaded and tell me how to use it.
  2. 2

    Paste it into Claude Code. It shows the change and asks before running it.

Requires Node.js, A Firecrawl account (or the keyless free tier).

The skill only gives your assistant instructions. The Firecrawl command line tool does the work, so install it and sign in first. Crawl needs an account: the skill says there is no keyless free tier, and without credentials the CLI prompts for a login. The one-command route installs the CLI, signs you in through the browser and adds the core and workflow skills for every editor it detects, not just this skill.

From the vendor's docs. Source.

What's in the skill

When it loads

Bulk-extract many pages from one site or section. Use for "crawl", "everything under /docs", or content spanning linked pages.

Sections in SKILL.md

  1. Quick start
  2. Tips
  3. See also

Key facts

Installs on skills.sh
81,009 as of 2026-11-02
Last commit to the repo
2026-10-28
What is inside
1 file (SKILL.md)

What it includes

  • Crawls a docs section and waits for it

    Saves JSON to .firecrawl/crawl.json. --include-paths keeps the crawl inside the section you name, and --limit caps the page count.

    Try: “Crawl the /docs section of example.com, up to 50 pages.”

    Runs code · firecrawl crawl "<url>" --include-paths /docs --limit 50 --wait

  • Crawls a whole site to a depth limit

    For when you need pages beyond one section.

    Runs code · --max-depth 3 --wait --progress

  • Checks a running crawl

    Without --wait, crawl returns a job ID to poll later.

    Runs code · firecrawl crawl <job-id>

  • Bounds how long the CLI waits

    --wait has no default timeout.

    Runs code · --timeout <seconds>

  • Shows remaining credits before a large crawl

    Needs an account. The skill says crawl uses credits per page.

    Runs code · firecrawl credit-usage

From the official docs

Permissions

Medium risk

This skill crawls sites through Firecrawl and spends credits for every page. Set a page limit and a path scope before you approve a crawl.

What it can do

  • Read your data
  • Create and change things
  • Delete things
  • Read-only mode

Watch out for

  • A wide crawl can use many credits

    Crawl uses credits per page. Scope it with --include-paths, set --limit, and check firecrawl credit-usage first. github.com

  • Web pages can try to steer your assistant

    The skill's own security note calls fetched web content untrusted and says it may contain prompt injection. Do not let the assistant follow instructions it finds on a page. github.com

  • Setup installs a global npm package

    The CLI is installed with npm install -g. The one-command setup also adds skills to every coding editor it detects, so use the single-skill route if you want only this one. github.com

  • The CLI sends anonymous usage data

    The README says it collects the CLI version, OS, Node.js version and which dev tools it detects during sign-in. Set FIRECRAWL_NO_TELEMETRY=1 to turn it off. github.com

Security advisories

No published security advisories as of Nov 2, 2026.

Technical details
Turning on read-onlyNo read-only mode. The skill runs CLI commands that spend credits and write files.
Talks toFirecrawl's API, or your own server if you set --api-url. Web pages the CLI fetches. Page content the assistant reads goes to your AI provider as part of the chat
Sign-in and keysBrowser sign-in stores credentials in the CLI. You can set FIRECRAWL_API_KEY instead.
Scopes
  • Runs firecrawl commands in your shell (the skill allows Bash(firecrawl *) and Bash(npx firecrawl-cli *))

Questions

What does firecrawl-crawl do?

It makes your assistant crawl a site with the Firecrawl CLI. It follows links up to a depth or page limit and saves the pages as JSON under .firecrawl/.

How do I install firecrawl-crawl?

Use the install box at the top of this page. You need the Firecrawl CLI and a sign-in as well as the skill. The one-command route installs the whole core skill set.

Do I need a Firecrawl account?

Yes. The SKILL.md says crawl needs authentication, has no keyless free tier, and prompts an interactive login without credentials.

How much does a crawl cost?

The SKILL.md says crawl uses credits per page and gives no price. Check firecrawl credit-usage before a large crawl, and scope it with --include-paths and --limit.

Is firecrawl-crawl safe to use?

It sends the start URL to Firecrawl and can spend many credits on a wide crawl. Pages are untrusted text. Set a page limit and a path scope before you approve a crawl.

firecrawl-crawl or firecrawl-map?

Use map to list a site's URLs and pick pages first. Use crawl when you need the content of many pages. The SKILL.md also points to firecrawl-download when you want local files instead of JSON.

Skill or Firecrawl MCP server?

They are two routes to Firecrawl. firecrawl-crawl is a SKILL.md that tells the assistant to run the Firecrawl CLI in your shell. The skill only allows Bash(firecrawl *) and Bash(npx firecrawl-cli *), so it needs an assistant that can run shell commands. The Firecrawl MCP server and the local Firecrawl MCP server give your client Firecrawl as tools it calls directly, with no skill involved. The README describes firecrawl setup mcp for adding the MCP server to your editors. You can use either route, or both.

Information

updated Nov 2, 2026

Repository
firecrawl/cli
Folder
skills/firecrawl-crawl

firecrawl/cliskills.sh

Sources

Docs, issue trackers and discussions this page is built from.

Show all 5
  1. Firecrawl CLI install rules · github.com
  2. firecrawl/cli README · github.com
  3. skills CLI commands · github.com
  4. firecrawl-crawl SKILL.md · github.com
  5. Firecrawl security rules · github.com

Updated Nov 2, 2026.