Skip to content

Releases: mendableai/firecrawl-mcp-server

v1.2.4: Configurable Settings & Enhanced Documentation

11 Feb 03:51
Compare
Choose a tag to compare

Overview

This release adds environment variable configuration support and enhances documentation, making the server more flexible and easier to configure.

🔧 Configuration Updates

New Environment Variables

  • Retry Configuration:
    • FIRE_CRAWL_RETRY_MAX_ATTEMPTS (default: 3)
    • FIRE_CRAWL_RETRY_INITIAL_DELAY (default: 1000ms)
    • FIRE_CRAWL_RETRY_MAX_DELAY (default: 10000ms)
    • FIRE_CRAWL_RETRY_BACKOFF_FACTOR (default: 2)
  • Credit Monitoring:
    • FIRE_CRAWL_CREDIT_WARNING_THRESHOLD (default: 1000)
    • FIRE_CRAWL_CREDIT_CRITICAL_THRESHOLD (default: 100)

📚 Documentation Improvements

  • Added comprehensive configuration examples
  • Enhanced retry behavior documentation with timing examples
  • Improved credit monitoring documentation
  • Updated Claude Desktop configuration guide

💡 Example Usage

Cloud API with custom retry settings

export FIRE_CRAWL_API_KEY=your-api-key
export FIRE_CRAWL_RETRY_MAX_ATTEMPTS=5
export FIRE_CRAWL_RETRY_INITIAL_DELAY=2000

Self-hosted with custom credit thresholds

export FIRE_CRAWL_API_URL=https://firecrawl.your-domain.com
export FIRE_CRAWL_CREDIT_WARNING_THRESHOLD=2000

🔍 Technical Details

  • All configuration options now support environment variable overrides
  • Maintained backward compatibility with default values
  • Enhanced error messages for configuration validation

📋 Full Changelog

See CHANGELOG.md for complete details.

v1.2.3: Optimize Batch Processing

10 Feb 16:53
Compare
Choose a tag to compare

What's Changed

Improvements

  • Removed redundant batch configuration to rely on FireCrawl library's built-in functionality
  • Simplified batch processing logic by leveraging library's native implementation
  • Optimized parallel processing and rate limiting handling
  • Reduced code complexity and potential configuration conflicts

Technical Details

  • Removed custom CONFIG.batch settings:
    • Removed maxParallelOperations configuration
    • Removed delayBetweenRequests configuration
  • Simplified batch operation processing to use library's built-in batch handling
  • Updated server startup logging to remove batch configuration references
  • Maintained credit usage tracking and error handling functionality

Benefits

  • More reliable batch processing using library's battle-tested implementation
  • Better handling of rate limits and concurrent operations
  • Reduced maintenance overhead
  • Improved code maintainability

v1.2.2: Type System and Error Handling Improvements

05 Feb 13:15
5ad8b85
Compare
Choose a tag to compare

This release focuses on improving type safety and error handling in the FireCrawl MCP server.

Key Improvements

  • Fixed type system warnings by properly implementing ExtractParams and ExtractResponse interfaces
  • Enhanced type safety in extract operations with improved type guards
  • Refined error messages for better configuration validation
  • Fixed API response type casting issues

Technical Details

  • Resolved unused TypeScript interface warnings
  • Improved type inference in extract operations
  • Enhanced type guards for better runtime validation
  • Updated error message formatting for configuration issues

Compatibility

  • Requires Node.js >= 18.0.0
  • Compatible with @mendable/firecrawl-js ^1.16.0
  • Compatible with @modelcontextprotocol/sdk ^1.4.1

v1.2.1

06 Jan 14:43
2390515
Compare
Choose a tag to compare

FireCrawl MCP Server v1.2.1 - Binary Configuration Hotfix

Changes

  • Fixed binary configuration in package.json to resolve npx execution issues
  • Simplified package configuration for better CLI tool support
  • Added proper file inclusions for npm package distribution
  • Updated package scripts to ensure proper build during installation

v1.2.0

03 Jan 10:29
Compare
Choose a tag to compare

FireCrawl MCP Server v1.2.0 - Enhanced Scraping & Search

Major Features

  • 🔍 New search tool (fire_crawl_search) for web search with content extraction
  • 🔄 Automatic retries with exponential backoff for rate limits
  • 📊 Credit usage monitoring for cloud API operations
  • 🚀 Queue system for batch operations with parallel processing
  • 🌐 Support for self-hosted FireCrawl instances

Improvements

  • Enhanced error handling for HTTP errors including 404s
  • Improved URL validation before scraping
  • Optimized rate limiting with automatic backoff strategy
  • Added comprehensive logging system
  • Updated configuration with new retry and batch processing options

Configuration Updates

  • New FIRE_CRAWL_API_URL environment variable for self-hosted instances
  • Automatic fallback to cloud API when no custom URL is provided
  • Enhanced rate limit configuration with retry options
  • Added batch processing parameters for parallel operations

Bug Fixes

  • Rate limit handling in batch operations
  • Error response formatting
  • Type definitions for response handlers
  • Test suite mock responses
  • Error handling for invalid search queries
  • API configuration validation

Requirements

  • Node.js >= 18.0.0
  • NPM or Yarn package manager

Installation

v1.0.2 - Fix JSON Communication

07 Dec 12:16
Compare
Choose a tag to compare

🐛 Bug Fixes

  • Fixed JSON parsing error in MCP communication
  • Removed plain text console.log that was breaking the protocol

🔧 Technical Details

  • All communication now properly follows MCP JSON format
  • Server initialization remains unchanged
  • Improved compatibility with Claude Desktop

📝 Notes

  • This is a critical fix for Claude Desktop integration
  • No changes to core functionality
  • Server status is now properly handled through MCP protocol

v1.0.1 - Path and Startup Message Fix

07 Dec 12:06
Compare
Choose a tag to compare

🔧 Fixes

  • Fixed binary path in package.json to correctly point to dist/src/index.js
  • Fixed start script path to match the dist structure
  • Added startup message for better server status visibility

🛠️ Technical Details

  • Updated bin path in package.json from dist/index.js to dist/src/index.js
  • Updated start script to use correct path
  • Added "FireCrawl MCP Server running on stdio" startup message

📝 Notes

  • No changes to core functionality
  • Improves server startup reliability
  • Better integration with Claude Desktop

🔍 Verification

You can verify the server is running by checking the Claude logs, which should now show:

v1.0.0 - Initial Release

06 Dec 10:39
Compare
Choose a tag to compare

Features

  • FireCrawl MCP Server implementation with advanced web scraping capabilities
  • Support for single URL and batch scraping operations
  • Multiple output formats (markdown, HTML, screenshots)
  • Smart rate limiting and error handling
  • Content filtering with include/exclude tags

Tools

fire_crawl_scrape

  • Single URL scraping with customizable options
  • Support for JavaScript-rendered content
  • Mobile/Desktop viewport options

fire_crawl_batch

  • Batch processing of multiple URLs
  • Asynchronous operation with job tracking
  • Same options as single scrape

fire_crawl_status

  • Check batch job status and results
  • Progress tracking with completion status

Technical Details

  • Built with TypeScript and Model Context Protocol SDK
  • Comprehensive test coverage
  • ESLint and Prettier integration
  • GitHub Actions for CI/CD
  • Node.js 20.x support