firecrawl-crawl Skill: Pull Every Page From a Site Section
Makes your coding assistant crawl a website or one section of it with Firecrawl and save the pages it finds.
- Installs
- 81K
- on skills.sh
- Stars
- 676
- on GitHub
- Updated
- Oct 2026
- last repo commit
firecrawl-crawl teaches your assistant to run firecrawl crawl <url>. A crawl follows links from a start page up to a depth or page limit and saves the content. The skill tells the assistant to scope crawls with --include-paths whenever you name a section.
You must install the Firecrawl CLI and sign in, because crawl has no keyless free tier. A crawl uses credits per page, so check usage first.
Good for
- Developers who want a whole docs section loaded for a coding task
- Researchers who need content that spans many linked pages
- Teams building a knowledge base from a site
Install firecrawl-crawl
Claude Code
- 1
Copy this prompt.
Install the firecrawl-crawl skill in Claude Code. Run this command: npm install -g firecrawl-cli@latest firecrawl login --browser npx skills add https://github.com/firecrawl/cli --skill firecrawl-crawl -a claude-code Then check that it loaded and tell me how to use it.
- 2
Paste it into Claude Code. It shows the change and asks before running it.
Requires Node.js, A Firecrawl account (or the keyless free tier).
The skill only gives your assistant instructions. The Firecrawl command line tool does the work, so install it and sign in first. Crawl needs an account: the skill says there is no keyless free tier, and without credentials the CLI prompts for a login. The one-command route installs the CLI, signs you in through the browser and adds the core and workflow skills for every editor it detects, not just this skill.
From the vendor's docs. Source.
What's in the skill
When it loads
Bulk-extract many pages from one site or section. Use for "crawl", "everything under /docs", or content spanning linked pages.
Sections in SKILL.md
- Quick start
- Tips
- See also
Key facts
- Author
- firecrawl org
- Repo
- firecrawl/cli
- Installs on skills.sh
- 81,009 as of 2026-11-02
- GitHub stars
- 676 for the whole firecrawl/cli repo, 2026-11-02
- Last commit to the repo
- 2026-10-28
- What is inside
- 1 file (SKILL.md)
- Related skills
- firecrawl-scrape, firecrawl-map, firecrawl-download
- skills.sh audits
- Gen Agent Trust Hub pass, Socket pass, Snyk warn (2026-11-02)
What it includes
Crawls a docs section and waits for it
Saves JSON to .firecrawl/crawl.json. --include-paths keeps the crawl inside the section you name, and --limit caps the page count.
Try: “Crawl the /docs section of example.com, up to 50 pages.”
Runs code ·
firecrawl crawl "<url>" --include-paths /docs --limit 50 --waitCrawls a whole site to a depth limit
For when you need pages beyond one section.
Runs code ·
--max-depth 3 --wait --progressChecks a running crawl
Without --wait, crawl returns a job ID to poll later.
Runs code ·
firecrawl crawl <job-id>Bounds how long the CLI waits
--wait has no default timeout.
Runs code ·
--timeout <seconds>Shows remaining credits before a large crawl
Needs an account. The skill says crawl uses credits per page.
Runs code ·
firecrawl credit-usage
From the official docs
Permissions
Medium risk
This skill crawls sites through Firecrawl and spends credits for every page. Set a page limit and a path scope before you approve a crawl.
What it can do
- Read your data
- Create and change things
- Delete things
- Read-only mode
Watch out for
A wide crawl can use many credits
Crawl uses credits per page. Scope it with --include-paths, set --limit, and check firecrawl credit-usage first. github.com
Web pages can try to steer your assistant
The skill's own security note calls fetched web content untrusted and says it may contain prompt injection. Do not let the assistant follow instructions it finds on a page. github.com
Setup installs a global npm package
The CLI is installed with npm install -g. The one-command setup also adds skills to every coding editor it detects, so use the single-skill route if you want only this one. github.com
The CLI sends anonymous usage data
The README says it collects the CLI version, OS, Node.js version and which dev tools it detects during sign-in. Set FIRECRAWL_NO_TELEMETRY=1 to turn it off. github.com
Security advisories
No published security advisories as of Nov 2, 2026.
Technical details
| Turning on read-only | No read-only mode. The skill runs CLI commands that spend credits and write files. |
|---|---|
| Talks to | Firecrawl's API, or your own server if you set --api-url. Web pages the CLI fetches. Page content the assistant reads goes to your AI provider as part of the chat |
| Sign-in and keys | Browser sign-in stores credentials in the CLI. You can set FIRECRAWL_API_KEY instead. |
| Scopes |
|
Questions
What does firecrawl-crawl do?
It makes your assistant crawl a site with the Firecrawl CLI. It follows links up to a depth or page limit and saves the pages as JSON under .firecrawl/.
How do I install firecrawl-crawl?
Use the install box at the top of this page. You need the Firecrawl CLI and a sign-in as well as the skill. The one-command route installs the whole core skill set.
Do I need a Firecrawl account?
Yes. The SKILL.md says crawl needs authentication, has no keyless free tier, and prompts an interactive login without credentials.
How much does a crawl cost?
The SKILL.md says crawl uses credits per page and gives no price. Check firecrawl credit-usage before a large crawl, and scope it with --include-paths and --limit.
Is firecrawl-crawl safe to use?
It sends the start URL to Firecrawl and can spend many credits on a wide crawl. Pages are untrusted text. Set a page limit and a path scope before you approve a crawl.
firecrawl-crawl or firecrawl-map?
Use map to list a site's URLs and pick pages first. Use crawl when you need the content of many pages. The SKILL.md also points to firecrawl-download when you want local files instead of JSON.
Skill or Firecrawl MCP server?
They are two routes to Firecrawl. firecrawl-crawl is a SKILL.md that tells the assistant to run the Firecrawl CLI in your shell. The skill only allows Bash(firecrawl *) and Bash(npx firecrawl-cli *), so it needs an assistant that can run shell commands. The Firecrawl MCP server and the local Firecrawl MCP server give your client Firecrawl as tools it calls directly, with no skill involved. The README describes firecrawl setup mcp for adding the MCP server to your editors. You can use either route, or both.
Information
updated Nov 2, 2026
- Repository
- firecrawl/cli
- Folder
skills/firecrawl-crawl
Sources
Docs, issue trackers and discussions this page is built from.
Show all 5Hide
- Firecrawl CLI install rules · github.com
- firecrawl/cli README · github.com
- skills CLI commands · github.com
- firecrawl-crawl SKILL.md · github.com
- Firecrawl security rules · github.com