Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add get_dataset_version method to catalog and metastore #640

Closed
wants to merge 3 commits into from

Conversation

mattseddon
Copy link
Member

@mattseddon mattseddon commented Nov 28, 2024

This PR was an attempt to solve an issue with dataset version previews taking too long to load. The theory was that we could cut down the amount of data being requested from the database by only calling for a single version with the dataset.

The main drawback of this approach is the need to add a further 2 dataclasses (one here and one in Studio). As a result, I have decided to go with #642. We can always come back to this if we need further performance improvements.

The required Studio changes can be found at https://github.com/iterative/studio/pull/10997

Copy link

cloudflare-workers-and-pages bot commented Nov 28, 2024

Deploying datachain-documentation with  Cloudflare Pages  Cloudflare Pages

Latest commit: bb2d1fb
Status: ✅  Deploy successful!
Preview URL: https://583b516e.datachain-documentation.pages.dev
Branch Preview URL: https://add-get-dataset-version.datachain-documentation.pages.dev

View logs

@mattseddon mattseddon force-pushed the add-get-dataset-version branch from 4c738ba to cb63b52 Compare November 28, 2024 03:43
Copy link

codecov bot commented Nov 28, 2024

Codecov Report

Attention: Patch coverage is 87.87879% with 8 lines in your changes missing coverage. Please review.

Project coverage is 87.75%. Comparing base (3bd22ad) to head (bb2d1fb).

Files with missing lines Patch % Lines
src/datachain/dataset.py 89.18% 4 Missing ⚠️
src/datachain/catalog/catalog.py 66.66% 2 Missing and 1 partial ⚠️
src/datachain/cli.py 0.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #640      +/-   ##
==========================================
+ Coverage   87.70%   87.75%   +0.04%     
==========================================
  Files         112      112              
  Lines       10672    10727      +55     
  Branches     1437     1438       +1     
==========================================
+ Hits         9360     9413      +53     
- Misses        954      955       +1     
- Partials      358      359       +1     
Flag Coverage Δ
datachain 87.69% <87.87%> (+0.04%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@mattseddon mattseddon self-assigned this Nov 28, 2024
@mattseddon mattseddon closed this Nov 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant