-
Notifications
You must be signed in to change notification settings - Fork 7
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
bee9b53
commit 8cb9436
Showing
5 changed files
with
35 additions
and
353 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,2 +1,34 @@ | ||
# LogReducer | ||
|
||
Open-source code for "On the Feasibility of Parser-based Log Compression in Large-Scale Cloud Systems" (USENIX FAST 2021) | ||
|
||
## Dependency | ||
python >= 3.8.5 | ||
|
||
pandas >= 1.1.1 | ||
|
||
six >= 1.15 | ||
|
||
numpy >= 1.19 | ||
|
||
gcc >= 7.4.0 | ||
|
||
7z >= 16.02 | ||
## Log Sample | ||
Samples of large scale cloud logs can be found at: | ||
|
||
https://github.com/THUBear-wjy/openSample | ||
|
||
## Compile | ||
`make` | ||
|
||
## Execution | ||
Assume the path of target log file is <em>/path/xx.log</em> | ||
|
||
Step 1: Training(Generate template at <em>./template/</em>) | ||
|
||
`python3 training.py -I /path/xx.log -T ./template/` | ||
|
||
Step 2: Compression(Using template at <em>./template/</em> and generate result at <em>./out/</em>) | ||
|
||
`python3 LogReducer.py -I /path/xx.log -T ./template/ -O ./out/` |
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.