Clojask Examples

Some commonly used examples for Clojure parallel data processing framework Clojask.

Usage

The example codes are stored in src/clojask_examples.

Change the value of :main in project.clj to the corresponding namespace of the example you want to run.

Run the example using

lein run

List of Examples

• Basic tutorial

  Cover the basic APIs in the Clojask library. Also cover how to read and write to different file formats.

• Groupby Aggregate

  Group-by, then aggregate v.s. direct aggregate.

• Join

  Natural inner join, left join and right join.

• Store Results in memory

  For datasets that are smaller than memory, you can store the result in memory and reuse it faster. This function is also necessary to read and write excel files.

• Connection with tech.ml.dataset

  Convert from and to the popular Clojure DataFrame library tech.ml.dataset.

• Rolling Join

  Forward and backward rolling join with thresholds. See the definition here.

• Enhanced Reshape

  Cbind, rbind, melt and dcast. See the definition of them in R.

• Timezone

  How to define parsers and formatters for fields of zoned datetime.

• Outer Join

  How to do Outer Join / Cartesian Product.