Skip to content

Commit

Permalink
feat(derive): wire in flushing
Browse files Browse the repository at this point in the history
  • Loading branch information
refcell committed Sep 26, 2024
1 parent 1943ba6 commit 061409b
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions crates/derive/src/stages/batch_queue.rs
Original file line number Diff line number Diff line change
Expand Up @@ -150,6 +150,9 @@ where
remaining.push(batch.clone());
}
BatchValidity::Drop => {
// If we drop a batch, flush previous batches buffered in the BatchStream
// stage.
self.prev.flush();

Check warning on line 155 in crates/derive/src/stages/batch_queue.rs

View check run for this annotation

Codecov / codecov/patch

crates/derive/src/stages/batch_queue.rs#L155

Added line #L155 was not covered by tests
warn!(target: "batch-queue", "Dropping batch with parent: {}", parent.block_info);
continue;
}
Expand Down

0 comments on commit 061409b

Please sign in to comment.