0f406f4ace
- Add h1 file title with manual description section to all doc files - Make all blocks use h2 headings (previously first block was h1) - Make all sections use h3 headings consistently - Add title fixes for GitHub, LLM, API, HubSpot, LinkedIn, etc. - Add --check warning for unfilled manual sections (116 files) - Fill in descriptions for top-level category files Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
1.4 KiB
Firecrawl Map
Add a description of this category of blocks.
Firecrawl Map Website
What it is
Firecrawl maps a website to extract all the links.
How it works
This block uses Firecrawl's mapping API to discover all links on a website without extracting full content. It quickly scans the site structure and returns a comprehensive list of URLs found.
The block is useful for understanding site architecture before performing targeted scraping or for building site maps. Results include both the raw list of links and structured results with titles and descriptions.
Inputs
| Input | Description | Type | Required |
|---|---|---|---|
| url | The website url to map | str | Yes |
Outputs
| Output | Description | Type |
|---|---|---|
| error | Error message if the map failed | str |
| links | List of URLs found on the website | List[str] |
| results | List of search results with url, title, and description | List[Dict[str, Any]] |
Possible use case
Site Audit: Map all pages on a website to identify broken links, orphan pages, or SEO issues.
Crawl Planning: Discover site structure before deciding which pages to scrape in detail.
Content Discovery: Find all blog posts, product pages, or documentation entries on a site.