Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: support passing pa.RecordBatch in con.insert/con.create_table #8133

Open
Tracked by #9638
jcrist opened this issue Jan 29, 2024 · 1 comment
Open
Tracked by #9638

feat: support passing pa.RecordBatch in con.insert/con.create_table #8133

jcrist opened this issue Jan 29, 2024 · 1 comment
Labels
ddl Issues related to creating or altering data definitions feature Features or general enhancements ux User experience related issues

Comments

@jcrist
Copy link
Member

jcrist commented Jan 29, 2024

This comes up when iterating over batches in to_pyarrow_batches in code like:

for batch in con1.to_pyarrow_batches(expr):
    con2.insert("table_name", batch)
    # currently this needs to be
    # con2.insert("table_name", pa.Table.from_batches([batch]))

Ideally in most places where it makes sense a pa.RecordBatch could be implicitly coerced to a pa.Table.

@jcrist jcrist added ux User experience related issues ddl Issues related to creating or altering data definitions feature Features or general enhancements labels Jan 29, 2024
@gforsyth
Copy link
Member

Additional feature here would be to allow creating a table from an entire RecordBatchReader (more applicable to create_table here)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ddl Issues related to creating or altering data definitions feature Features or general enhancements ux User experience related issues
Projects
Status: backlog
Development

No branches or pull requests

2 participants