Skip to content

Basic implementation of Parquet file format for Bun

License

Notifications You must be signed in to change notification settings

MagicFun1241/parquet-bun

Repository files navigation

Parquet Bun

Basic implementation of Parquet file format for Bun

To install library:

bun add parquet-bun

Example

import {openFile} from "parquet-bun";

const schema = {
    'name': {
        type: 'BYTE_ARRAY',
        convertedType: 'UTF8',
        encoding: 'PLAIN_DICTIONARY'
    },
    'male': {
        type: 'BOOLEAN',
    }
} as const;

const writer = openFile('test', schema, 'test.parquet');

writer.appendRow({
    name: 'Emily',
    male: false
});

writer.appendRow({
    name: 'Bob',
    male: true
});

writer.close();

Roadmap

  • Implement POC
  • Support all types from TypeList
  • Improve schema building
  • Improve inference from schema

License

MIT