Skip to content

Commit

Permalink
formatting
Browse files Browse the repository at this point in the history
  • Loading branch information
thinkharderdev committed Feb 6, 2023
1 parent 6fe699c commit f8a339d
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions datafusion/core/src/physical_plan/file_format/file_stream.rs
Original file line number Diff line number Diff line change
Expand Up @@ -99,10 +99,10 @@ enum FileStreamState {
partition_values: Vec<ScalarValue>,
/// The reader instance
reader: BoxStream<'static, Result<RecordBatch, ArrowError>>,
/// A [`FileOpenFuture`] for the next file to be processed,
/// A [`FileOpenFuture`] for the next file to be processed,
/// and its corresponding partition column values, if any.
/// This allows the next file to be opened in parallel while the
/// current file is read.
/// current file is read.
next: Option<(FileOpenFuture, Vec<ScalarValue>)>,
},
/// Encountered an error
Expand Down Expand Up @@ -208,11 +208,11 @@ impl<F: FileOpener> FileStream<F> {
})
}

// Begin opening the next file in parallel while decoding the current file in FileStream.
// Since file opening is mostly IO (and may involve a
// bunch of sequential IO), it can be parallelized with decoding.
// Begin opening the next file in parallel while decoding the current file in FileStream.
// Since file opening is mostly IO (and may involve a
// bunch of sequential IO), it can be parallelized with decoding.
fn start_next_file(&mut self) -> Option<Result<(FileOpenFuture, Vec<ScalarValue>)>> {
let part_file = self.file_iter.pop_front()?;
let part_file = self.file_iter.pop_front()?;

let file_meta = FileMeta {
object_meta: part_file.object_meta,
Expand Down

0 comments on commit f8a339d

Please sign in to comment.