-
Notifications
You must be signed in to change notification settings - Fork 8
Simple utility to convert an existing compressed file in an Hadoop SequenceFile
License
noiano/tar2seq
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
This project was originally developed by [Stuart Sierra](http://stuartsierra.com/2008/04/24/a-million-little-files) I've slightly modified it in order to make it fit my need. My first objective was to extend the [Terrier IR platform](http://www.terrier.org) so that it can process large text collection packed up in sequence files (see [issue 182](http://terrier.org/issues/browse/TR-182)) #### How to use 1. ant (it will create tar-to-seq.jar) 2. java -jar tar-to-seq.jar [-c] <collection path> <destination path> example: java -jar tar-to-seq.jar -c trec.tar.gz trec.seq Use the optional -c option to enable record compression
About
Simple utility to convert an existing compressed file in an Hadoop SequenceFile
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published