DataPortraits

Implementing the Paper: Data Portraits for Recording Foundation Model Training Data Paper: https://arxiv.org/abs/2303.03919

Introduction

Requires spdlog, Google-test, MurmurHash3

sudo apt-get install libspdlog-dev.

sudo apt-get install libgtest-dev.
export CMAKE_PREFIX_PATH=/path/to/gtest:$CMAKE_PREFIX_PATH

sudo apt-get install libmurmurhash3-dev

Code Structure

• benchmark -- application code to use the generated shared library
• cmake -- cmake configuration files
• docs -- any documents
• include -- all the header files
• src -- corresponding source files, will generate a shared library
• test -- test code based on google test