Code

[WIP] Rebase onto Apache Arrow 7.0.0#83

Code

Merged

zhztheplayer merged 54 commits intooap-project:arrow-7.0.0-oapoap-project/arrow:arrow-7.0.0-oapfrom zhztheplayer:oap-arrow7-rebasezhztheplayer/arrow-1:oap-arrow7-rebaseCopy head branch name to clipboardFeb 28, 2022

+7,267-1,462

Commits

Commits on Jan 25, 2022

• [Arrow 3.0 Rebase] Rebase Shuffle component c++ and Java API (apache#109)

  Show description for 7fb56b5
  

  2 peopleauthored and

  zhztheplayer

  committed
  7fb56b5

  Copy full SHA for 7fb56b5

• [C++][Gandiva] Adding abs function

  Show description for 96cb97a
  

  zhouyuan

  authored and

  zhztheplayer

  committed
  96cb97a

  Copy full SHA for 96cb97a

• [C++][Gandiva] update function registry for abs

  Show description for 11d7f00
  

  zhouyuan

  authored and

  zhztheplayer

  committed
  11d7f00

  Copy full SHA for 11d7f00

• [C++]support castINT from date32

  Show description for e2e1f0d
  

  zhouyuan

  authored and

  zhztheplayer

  committed
  e2e1f0d

  Copy full SHA for e2e1f0d

• [C++][Gandiva] Support more types for Cast

  Show description for 491a16f
  

  zhouyuan

  authored and

  zhztheplayer

  committed
  491a16f

  Copy full SHA for 491a16f

• [C++][Gandiva] Adding more functions that are required by native SQL engine

  Show description for b7468a1
  

  zhouyuan

  authored and

  zhztheplayer

  committed
  b7468a1

  Copy full SHA for b7468a1

• Revert "[oap-native-sql] adding round support"

  Show description for b0f9c3a
  

  zhouyuan

  authored and

  zhztheplayer

  committed
  b0f9c3a

  Copy full SHA for b0f9c3a

Commits on Jan 26, 2022

• Support the decompress feature in shuffle component. (apache#3)

  Show description for a634d04
  

  2 peopleauthored and

  zhztheplayer

  committed
  a634d04

  Copy full SHA for a634d04

• Add Plasma Metrics API (apache#4)

  Show description for 0379d8d
  

  jikunshang

  authored and

  zhztheplayer

  committed
  0379d8d

  Copy full SHA for 0379d8d

• add plasma java client metrics api (apache#7)

  

  jikunshang

  authored and

  zhztheplayer

  committed
  e997f70

  Copy full SHA for e997f70

• Use 8MB block size for native memory pool

  zhztheplayer

  committed
  7cf62c7

  Copy full SHA for 7cf62c7

• fix fastpfor (apache#46)

  Show description for b9af487
  

  zhouyuan

  authored and

  zhztheplayer

  committed
  b9af487

  Copy full SHA for b9af487

• update fastpfor (apache#45)

  Show description for f3b95c6
  

  zhouyuan

  authored and

  zhztheplayer

  committed
  f3b95c6

  Copy full SHA for f3b95c6

Commits on Feb 8, 2022

• Dataset: Support reading from fixed offset of a file for Parquet format

  zhztheplayer

  committed
  f08c8bd

  Copy full SHA for f08c8bd

• Fix fastpfor as of 7.0.0

  zhztheplayer

  committed
  5cd0394

  Copy full SHA for 5cd0394

• Dataset Java API: Add CSV support

  zhztheplayer

  committed
  75bea9a

  Copy full SHA for 75bea9a

• Expose NativeUnderlyingMemory

  zhztheplayer

  committed
  21cd938

  Copy full SHA for 21cd938

• add the timestamp unit convert and date64 to date32 convert (apache#10)

  

  JkSelf

  authored and

  zhztheplayer

  committed
  794f3c9

  Copy full SHA for 794f3c9

• [POAE7-932]Add QAT compression support (apache#5)

  Show description for 8ab5fd8
  

  xieqi

  authored and

  zhztheplayer

  committed
  8ab5fd8

  Copy full SHA for 8ab5fd8

• add normalize function (apache#11)

  

  rui-mo

  authored and

  zhztheplayer

  committed
  a940aad

  Copy full SHA for a940aad

• fix normalize function (apache#13)

  

  rui-mo

  authored and

  zhztheplayer

  committed
  f9a1288

  Copy full SHA for f9a1288

• adding standalone libhdfs3 dir (apache#15)

  Show description for b0b1d2d
  

  zhouyuan

  authored and

  zhztheplayer

  committed
  b0b1d2d

  Copy full SHA for b0b1d2d

• Add function castBIGINT_timestamp (apache#22)

  Show description for 5f36fef
  zhztheplayer

  committed
  5f36fef

  Copy full SHA for 5f36fef

• Add Gandiva functions for datetime (apache#23)

  zhztheplayer

  committed
  ebd35c1

  Copy full SHA for ebd35c1

• Dataset API: Allow empty projection (apache#24)

  zhztheplayer

  committed
  0f5d19c

  Copy full SHA for 0f5d19c

• Add int32 support and change format of castVarchar (apache#26)

  Show description for d7c47ee
  

  rui-mo

  authored and

  zhztheplayer

  committed
  d7c47ee

  Copy full SHA for d7c47ee

• Create utility dir arrow/jniutil (apache#27)

  Show description for 360a506
  zhztheplayer

  committed
  360a506

  Copy full SHA for 360a506

• Dataset Java API: Allow passing dataset read options when creating file format (apache#30)

  zhztheplayer

  committed
  f5932af

  Copy full SHA for f5932af

• Fix data and timestamp functions (apache#29)

  Show description for 69e411c
  

  rui-mo

  authored and

  zhztheplayer

  committed
  69e411c

  Copy full SHA for 69e411c

• Wrong result of ReservationListenableMemoryPool::Impl::bytes_allocated()

  zhztheplayer

  committed
  199a048

  Copy full SHA for 199a048

• Add AutoBufferLedger (apache#31)

  zhztheplayer

  committed
  7d902e7

  Copy full SHA for 7d902e7

• Unsafe Serialization: Null count is always set to 0 (apache#33)

  zhztheplayer

  committed
  32ffa5c

  Copy full SHA for 32ffa5c

• Hybrid Java buffer release: Support both manual and auto release at the same time (apache#34)

  Show description for 9b6aaa1
  zhztheplayer

  committed
  9b6aaa1

  Copy full SHA for 9b6aaa1

• IllegalStateException reading data with struct type (apache#43)

  zhztheplayer

  committed
  cef4f71

  Copy full SHA for cef4f71

• Support "return null" if there is an exception in casting string to int, bigint, float or double (apache#44)

  Show description for 5275cd6
  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  5275cd6

  Copy full SHA for 5275cd6

• implement json functions (apache#49)

  Show description for 05103af
  

  zhouyuan

  authored and

  zhztheplayer

  committed
  05103af

  Copy full SHA for 05103af

• AllocationListener should be called in BufferLedger#transferBalance(...) (apache#51)

  zhztheplayer

  committed
  deca0eb

  Copy full SHA for deca0eb

• Fix issue in get_json_object (apache#50)

  Show description for e0d52e7
  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  e0d52e7

  Copy full SHA for e0d52e7

• Fix issues in multi-key json case and empty value case (apache#54)

  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  39f38ab

  Copy full SHA for 39f38ab

• Support no hyphen included date format in castVARCHAR_date32_int64 and fix issue in unit test (apache#56)

  Show description for c6b05d4
  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  c6b05d4

  Copy full SHA for c6b05d4

• Add date32 support for date_sub (apache#57)

  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  93f72ed

  Copy full SHA for 93f72ed

• Update Intel Security.md (apache#58)

  

  weiting-chen

  authored and

  zhztheplayer

  committed
  4d0871b

  Copy full SHA for 4d0871b

• Add check for input date string (apache#59)

  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  9386c78

  Copy full SHA for 9386c78

• Support casting boolean to bigint (apache#60)

  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  32ce8e4

  Copy full SHA for 32ce8e4

• Install re2 headers (apache#66)

  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  7e5ae02

  Copy full SHA for 7e5ae02

• Add translate expression support (apache#68)

  Show description for 7f40757
  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  7f40757

  Copy full SHA for 7f40757

• Return 1 if empty string is given as substring (apache#69)

  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  ca2d251

  Copy full SHA for ca2d251

• Add two math operations: floor & ceil (apache#72)

  Show description for 360c5ef
  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  360c5ef

  Copy full SHA for 360c5ef

• Fix wrong Tell() result from BufferedOutputStream in an edge case (apache#73)

  zhztheplayer

  committed
  31917cc

  Copy full SHA for 31917cc

• Add UnlockedBufferedOutputStream (apache#75)

  zhztheplayer

  committed
  bdea3c4

  Copy full SHA for bdea3c4

• Add rand function for seed in int64 type (apache#78)

  Show description for 7e85a39
  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  7e85a39

  Copy full SHA for 7e85a39

• Pass partition ID to rand expression for achieving genuine random distribution globally (apache#80)

  Show description for 9cb3bbf
  

  PHILO-HE

  authored and

  zhztheplayer

  committed
  9cb3bbf

  Copy full SHA for 9cb3bbf

Commits on Feb 28, 2022

• 7.0.0 rebase compilation fix

  zhztheplayer

  committed
  b302ead

  Copy full SHA for b302ead

• 7.0.0 rebase test fix

  zhztheplayer

  committed
  f7eabe1

  Copy full SHA for f7eabe1