Thunderbolt is data manager for gokart.
- Auto loading gokart task logs
- Check task params using pandas
- Download data from python
pip install thunderbolt
If you specify TASK_WORKSPACE_DIRECTORY
, thunderbolt reads the log.
So making tasks pandas.DataFrame, and load dumped data.
This is also possible from S3 or GCS. (s3://, gs://)
Example:
from thunderbolt import Thunderbolt
tb = Thunderbolt()
print(tb.get_task_df())
print(tb.get_data('TASK_NAME'))
Please look here too: https://github.com/m3dev/thunderbolt/blob/master/examples/example.ipynb