Compressed Log Processor (CLP) is a tool capable of losslessly compressing text logs and searching the compressed logs without decompression. To learn more about it, you can read our paper.
You can download a release from the releases page or you can build the latest by using the packager.
CLP is currently split across a few different components in the components directory:
- clp-py-utils contains Python utilities common to several of the other components.
- compression-job-handler contains code to submit compression jobs to a cluster.
- core contains code to compress uncompressed logs, decompress compressed logs, and search compressed logs.
- job-orchestration contains code to schedule compression jobs on the cluster.
- package-template contains the base directory structure and files of the CLP package.
The packages held by this repository are:
- Docker Image
clp/clp-core-dependencies-x86-ubuntu-focal- A docker image containing all the necessary dependencies to build CLP core in an Ubuntu Focal x86 environment
- Docker Image
clp/clp-core-dependencies-x86-ubuntu-bionic- A docker image containing all the necessary dependencies to build CLP core in an Ubuntu Bionic x86 environment
- Docker Image
clp/clp-core-dependencies-x86-centos7.4- A docker image containing all the necessary dependencies to build CLP core in a Centos 7.4 x86 environment
- Docker Image
clp/clp-execution-x86-ubuntu-focal- A docker image containing all the necessary dependencies to run the full CLP package in an x86 environment
- Docker Image
clp/clp-core-x86-ubuntu-focal- A docker image containing CLP (clp, clg, clo, etc.) binaries built in an Ubuntu Focal x86 environment
This is our open-source release which we will be constantly updating with bug fixes, features, etc. If you would like a feature or want to report a bug, please file an issue and we'll be happy to engage. We also welcome any contributions!