Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-7744: [Java][FlightRPC] JDBC Driver for Arrow Flight SQL #13800

Merged
merged 1,532 commits into from
Sep 14, 2022

Conversation

jduo
Copy link
Member

@jduo jduo commented Aug 4, 2022

No description provided.

iurysalino and others added 30 commits March 29, 2022 10:09
* Make UTC the default tz instead of using local tz

* Use Avatica DateTimeUtils for getString in Date/Time/TimeStamp

* Correct usage for unix*ToString

* Add unit tests for Date/Time getString

* Check wasNull
…e#16)

* Add support for getUnicodeStream

* nit: remove outofscope changes

* Fix small mistake in one of the added tests

* nit: remove unused imports

* Simplify PR
@lidavidm
Copy link
Member

Great, CI looks good now (minus known extant issues). I'll give this a final review soon

Copy link
Member

@lidavidm lidavidm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As noted there are several items here to improve but I think we should get this in and keep working on it. I filed ARROW-17729 with several items to address and @avantgardnerio has some useful improvements that should be reviewed and merged too

@lidavidm
Copy link
Member

CI failures are unrelated/addressed elsewhere

@lidavidm lidavidm merged commit eb00620 into apache:master Sep 14, 2022
@avantgardnerio
Copy link

Awesome news! Thank you very much for all the hard work that went into this. My company is very excited to make some PRs in the near future :)

@ursabot
Copy link

ursabot commented Sep 15, 2022

Benchmark runs are scheduled for baseline = 9c628b7 and contender = eb00620. eb00620 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Finished ⬇️0.34% ⬆️0.0%] test-mac-arm
[Failed ⬇️0.0% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️0.35% ⬆️0.0%] ursa-thinkcentre-m75q
Buildkite builds:
[Finished] eb00620b ec2-t3-xlarge-us-east-2
[Finished] eb00620b test-mac-arm
[Failed] eb00620b ursa-i9-9960x
[Finished] eb00620b ursa-thinkcentre-m75q
[Finished] 9c628b70 ec2-t3-xlarge-us-east-2
[Finished] 9c628b70 test-mac-arm
[Failed] 9c628b70 ursa-i9-9960x
[Finished] 9c628b70 ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

zagto pushed a commit to zagto/arrow that referenced this pull request Oct 7, 2022
…e#13800)

Lead-authored-by: James Duong <duong.james@gmail.com>
Co-authored-by: iurysalino <iurysalino@gmail.com>
Co-authored-by: Vinicius Fraga <62815192+vfraga@users.noreply.github.com>
Signed-off-by: David Li <li.davidm96@gmail.com>
fatemehp pushed a commit to fatemehp/arrow that referenced this pull request Oct 17, 2022
…e#13800)

Lead-authored-by: James Duong <duong.james@gmail.com>
Co-authored-by: iurysalino <iurysalino@gmail.com>
Co-authored-by: Vinicius Fraga <62815192+vfraga@users.noreply.github.com>
Signed-off-by: David Li <li.davidm96@gmail.com>
Yicong-Huang added a commit to Texera/texera that referenced this pull request Dec 13, 2022
This PR bumps Apache Arrow version from 9.0.0 to 10.0.0.

Main changes related to PyAmber:

## Java/Scala side:

- JDBC Driver for Arrow Flight SQL
([13800](apache/arrow#13800))
- Initial implementation of immutable Table API
([14316](apache/arrow#14316))
- Substrait, transaction, cancellation for Flight SQL
([13492](apache/arrow#13492))
- Read Arrow IPC, CSV, and ORC files by NativeDatasetFactory
([13811](apache/arrow#13811),
[13973](apache/arrow#13973),
[14182](apache/arrow#14182))
- Add utility to bind Arrow data to JDBC parameters
([13589](apache/arrow#13589))

## Python side:

- The batch_readahead and fragment_readahead arguments for scanning
Datasets are exposed in Python
([ARROW-17299](https://issues.apache.org/jira/browse/ARROW-17299)).
- ExtensionArrays can now be created from a storage array through the
pa.array(..) constructor
([ARROW-17834](https://issues.apache.org/jira/browse/ARROW-17834)).
- Converting ListArrays containing ExtensionArray values to numpy or
pandas works by falling back to the storage array
([ARROW-17813](https://issues.apache.org/jira/browse/ARROW-17813)).
- Casting Tables to a new schema now honors the nullability flag in the
target schema
([ARROW-16651](https://issues.apache.org/jira/browse/ARROW-16651)).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.