You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm pretty sure the batch size you can set with a gdal property before you get the stream. If you have a pyarrrow.RecordBatchReader, which I'm assuming is what GetArrowStreamAsPyArrow gives you, you can consume it one batch at a time or call https://arrow.apache.org/docs/python/generated/pyarrow.RecordBatchReader.html#pyarrow.RecordBatchReader.read_all to read it into a Table (probably what you want unless you're engineering some streaming yourself).
In R you might have a nanoarrow_array_stream, on which you call convert_array_stream() to get a data.frame. I think you can also call as_arrow_table() on the array stream (or as_arrow_table(as_record_batch_reader(array_stream)) if that doesn't work)
The text was updated successfully, but these errors were encountered:
DD
The text was updated successfully, but these errors were encountered: