Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐍🐎 Large data mode #207

Merged
merged 14 commits into from
Jan 24, 2022
Merged

🐍🐎 Large data mode #207

merged 14 commits into from
Jan 24, 2022

Conversation

evanroyrees
Copy link
Collaborator

@evanroyrees evanroyrees commented Dec 21, 2021

  • 🎨🐍 Add large-data-mode entrypoints
  • 🎨🐍 Refactor common binning utilities in recursive_dbscan.py to autometa/binning/utilities.py

This was originally submitted with PR #182. That PR has since been fragmented into the following PRS:

🎨 add utilities script to hold common binning utilities for binning modules
🎨 update metabin stat summary calculations in summary.py
🎨 Add large_data_mode.py and large_data_mode_loginfo.py modules
@evanroyrees evanroyrees added enhancement New feature or request python Python related issues/code labels Dec 21, 2021
@evanroyrees evanroyrees changed the title 🐍 Large data mode 🐍🐎 Large data mode Jan 6, 2022
@evanroyrees evanroyrees linked an issue Jan 19, 2022 that may be closed by this pull request
@evanroyrees evanroyrees merged commit 832734c into dev Jan 24, 2022
@evanroyrees evanroyrees deleted the large-data-mode branch January 25, 2022 22:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request python Python related issues/code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Large data mode needs more granular checkpointing during clustering
1 participant