Skip to main content

Firecrawl

Firecrawl's integration with Boltic automates web data workflows—scraping pages, crawling sites, mapping content, and enabling advanced search. Its AI-powered extract operation lets you pull specific fields or entities, making web data discovery and structuring seamless within Boltic pipelines.

Getting Started​

Before using the Firecrawl node, you'll need to complete a few setup steps.

Prerequisites​

  • Firecrawl Account: You must have a Firecrawl account. Sign up at firecrawl.dev if you haven't already.
  • Firecrawl API Key: Obtain an API key from Firecrawl by following the instructions in the Firecrawl API documentation.

Supported Authentication Methods​

The Firecrawl node supports the following authentication methods:

  • API Key: Use your Firecrawl API key for the simple and straightforward authentication.

Basic Operations​

Here are some of the basic operations you can perform with the Firecrawl node:

Crawling​

  • Crawl website: Begin crawling a website to discover and fetch linked pages and their content.
  • Crawl Status: Check the status or results of an ongoing or completed crawl job.

Scraping​

  • Scrape: Scrape a specific web page for structured data.
  • Batch Scrape: Scrape multiple web pages in a single operation.
  • Batch Scrape Status: Get the status or result of a scrape or batch scrape job.

Data Mapping & Search​

  • Map: Define or update a data extraction schema for a page or group of pages.
  • Search: Search previously crawled or scraped data using specific filters.

AI-powered Extraction​

  • Extract: Use AI-powered prompts to extract targeted entities or fields from a web page or crawl result.
  • Extract Status: Get the status and result of an extract operation.

Conclusion​

Firecrawl for Boltic makes web data extraction easy, fast, and flexible—enabling you to automate everything from crawling to AI-powered extraction within your workflows.

For more detailed information on the Firecrawl API and its capabilities, visit the Firecrawl Developer Documentation.