data-raw

Intro

This repo compiles all the raw data prep processes that include but not limited to:

• data sources discovery
• data crawling
• data generation (by the current LLMs perhaps)
• data augmentation
• data cleaning
• data deduplication
• ...