[persistence] pyarrow to sqlite ingestion of evals #2778

mikeldking · 2024-04-05T16:34:58Z

Take pyarrow file ingests and perform bulk inserts on annotation tables. Note that this can cause permance issues so needs to be stress tested.

mikeldking mentioned this issue Apr 5, 2024

🗺️ Persistence #1689

Closed

github-project-automation bot added this to phoenix Apr 5, 2024

github-project-automation bot moved this to 📘 Todo in phoenix Apr 5, 2024

mikeldking self-assigned this Apr 5, 2024

dosubot bot added the c/evals label Apr 5, 2024

mikeldking assigned axiomofjoy and unassigned mikeldking Apr 5, 2024

axiomofjoy moved this from 📘 Todo to 👨‍💻 In progress in phoenix Apr 9, 2024

This was referenced Apr 10, 2024

feat: ingest pyarrow span evals into sqlite #2837

Merged

feat: ingest document evals #2847

Merged

feat: ingest trace evals #2852

Merged

axiomofjoy linked a pull request Apr 10, 2024 that will close this issue

chore: ingest fixture evals #2846

Merged

axiomofjoy moved this from 👨‍💻 In progress to ✅ Done in phoenix Apr 11, 2024

axiomofjoy mentioned this issue Apr 11, 2024

fix: improve error handling and logging for eval insertions #2854

Merged

mikeldking closed this as completed Apr 12, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[persistence] pyarrow to sqlite ingestion of evals #2778

[persistence] pyarrow to sqlite ingestion of evals #2778

mikeldking commented Apr 5, 2024 •

edited

Loading

[persistence] pyarrow to sqlite ingestion of evals #2778

[persistence] pyarrow to sqlite ingestion of evals #2778

Comments

mikeldking commented Apr 5, 2024 • edited Loading

mikeldking commented Apr 5, 2024 •

edited

Loading