[Bug] asyncBatchScrapeUrls + schema extract doesn't work

[hala94]

Describe the Bug

• invoking asyncBatchScrapeUrls SDK method with extract+schema will silently fail
• data is not received when checking the status via checkBatchScrapeStatus
• batch_scrape.page event is never received in the supplied webhook
• everything looks like a success, but the data is just missing
• same action will complete successfully when a sync method is used

Status response example:

{
  success: true,
  status: "completed",
  total: 0,
  completed: 0,
  creditsUsed: 0,
  next: undefined,
  expiresAt: 2025-01-26T09:47:16.000Z,
  data: [],
}

To Reproduce

await firecrawl.asyncBatchScrapeUrls(
    ["https://www.firecrawl.dev/"],
    {
      onlyMainContent: true,
      formats: ["extract"],
      extract: {
        prompt: "Extract title.",
        schema: z.object({
          title: z.string(),
        }),
      },
    }
  );

Expected Behavior

• either extract is completed sucessfully or a webhook event + status check should indicate an error

webhook events should be:

1. batch_scrape.started
2. batch_scrape.page - this contains data
3. batch_scrape.completed or batch_scrape.failed

Environment (please complete the following information):

• OS: [macOS]
• Firecrawl Version: [1.15.7]
• Node.js Version: [20.0.0]

[nickscamara]

@mogery can you please take a look at this one?

[hala94]

any progress on this?

[mogery]

Fixed! Thanks for reporting, sorry for taking so long!