PARQUET-77: ByteBuffer use in read and write paths#267

Closed

jaltekruse wants to merge 102 commits intoapache:masterfrom

jaltekruse:1.6.0rc3-drill-r0.3-merge

Commits on Feb 10, 2015

Use ByteBuf-based api to read magic.

gerashegalov
authored and
adeneche
committed
Reading file metadata using zero-copy API

gerashegalov
authored and
adeneche
committed
Reading chunk using zero-copy API

dsy88
authored and
adeneche
committed
Add ByteBufferInputStream and modify Chunk to consume ByteBuffer instead

dsy88
authored and
adeneche
committed
Read from ByteBuffer instead of ByteArray to avoid unnecessary array copy

dsy88
authored and
adeneche
committed
Using Writable Channel to replace write to OutputStream one by one.

dsy88
authored and
adeneche
committed
Add original readIntLittleEndian function to keep compatible with previous

dsy88
authored and
adeneche
committed
Add a Hadoop compatible layer to abstract away the zero copy API and old

dsy88
authored and
adeneche
committed
Move CompatibilityUtil to parquet.hadoop.util.

dsy88
authored and
adeneche
committed
Implement FSDISTransport in Compatible layer.

dsy88
authored and
adeneche
committed
Make BytePacker consume ByteBuffer directly.

dsy88
authored and
adeneche
committed
disable enforcer to pass build.

dsy88
authored and
adeneche
committed
remove some unncessary codes.

dsy88
authored and
adeneche
committed
fix a bug in equals in ByteBuffer Binary with offset and length

dsy88
authored and
adeneche
committed
enable enforcer check.

dsy88
authored and
adeneche
committed
Address tsdeng's comments

dsy88
authored and
adeneche
committed

Commits on Feb 19, 2015

Commits on Mar 2, 2015

Make constructor for PrimitiveType that takes decimalMetadata public.

StevenMPhillips
authored and
adeneche
committed
Revert readFooter to not use ZeroCopy path.

parthchandra
authored and
adeneche
committed
Fix allocation in DictionaryValuesWriter

StevenMPhillips
authored and
adeneche
committed

Commits on Mar 8, 2015

Commits on Mar 9, 2015

cherry pick pull#188

rdblue
authored and
adeneche
committed

Commits on Mar 30, 2015

bumped version to 1.6.0rc3-drill-r0.1
adeneche
committed

Commits on May 3, 2015

Commits on May 5, 2015

Commits on Aug 26, 2015

Merge branch 'master' into 1.6.0rc3-drill-r0.3-merge
jaltekruse
committed

Commits on Aug 31, 2015

Commits on Sep 1, 2015

Moving classes out of the old packages.
jaltekruse
committed

Commits on Sep 4, 2015

Commits on Sep 9, 2015

Rename CapacityByteArrayOutputStream to CapacityByteBufferOutputStream to reflect new implementation internals. Add close method to CapacityByteBufferOutputStream and a few other classes.
jaltekruse
committed

Commits on Sep 12, 2015

Fix issue reading page data into an off-heap ByteBuffer
jaltekruse
committed

Commits on Sep 15, 2015

Fixes made while debugging drill unit tests
jaltekruse
committed

Commits on Sep 29, 2015

Commits on Oct 1, 2015

Commits on Oct 2, 2015

Commits on Oct 5, 2015

Commits on Oct 14, 2015

Commits on Oct 24, 2015

Addressing review comments
jaltekruse
committed

Commits on Oct 26, 2015

fix license leader
Jason Altekruse
committed
Add test for UnsignedVarIntBytesInput
Jason Altekruse
committed
Added javadocs, removed unused code in DirectCodecFactory
Jason Altekruse
committed
Add license header to new class
Jason Altekruse
committed

Commits on Oct 29, 2015

Commits on Oct 31, 2015

Address review comments
jaltekruse
committed

Commits on Nov 1, 2015

Commits on Nov 2, 2015

Commits on Nov 3, 2015

Properly set the byte buffer position when reading out of a filesystem that does not implement the byte buffer based read method in the Hadoop 2.x API.
jaltekruse
committed

Commits on Nov 4, 2015