Skip to content

Issues: mosaicml/streaming

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

45 Open 121 Closed
45 Open 121 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Dataset does not work after stopping training bug Something isn't working
#781 opened Sep 15, 2024 by AugustDev
1
Sparse Numpy Arrays enhancement New feature or request
#780 opened Sep 10, 2024 by Matagi1996
JointWriter: Allow shard file appending bug Something isn't working
#775 opened Sep 5, 2024 by janEbert
2
GCS Auth ERROR/Download timeout bug Something isn't working
#774 opened Sep 5, 2024 by rishabhm12
MemoryError: Unable to allocate bug Something isn't working
#771 opened Sep 2, 2024 by AugustDev
1
File exists: '/000000_epoch_shape' when using the ddp strategy from pytorch lightning bug Something isn't working
#767 opened Aug 25, 2024 by elbamos
23
Estimate total shards at the beginning of data conversion enhancement New feature or request
#742 opened Aug 3, 2024 by abhijithneilabraham
1
huge temp files while uploading data using MDS writer bug Something isn't working
#734 opened Jul 24, 2024 by MaxxP0
2
GCS: Mosiacml-streaming overloads the GCP metadata service when too many processes are used. bug Something isn't working
#728 opened Jul 18, 2024 by smspillaz
1
Download optimal for device_per_stream batching method.
#726 opened Jul 16, 2024 by huxuan
4
Replication changes sample order bug Something isn't working
#725 opened Jul 15, 2024 by CodeCreator
3
'File exists: "/00000_locals"' when integrated with deepspeed training scripts bug Something isn't working
#717 opened Jul 8, 2024 by Clement25
4
All processes allocate memory on rank 0 during StreamingDataset initialization in a distributed setting bug Something isn't working
#716 opened Jul 2, 2024 by ohallstrom
4
Optional dependency for different storages? enhancement New feature or request
#709 opened Jun 24, 2024 by huxuan
2
Suboptimal usage of 8xH100 GPUs - Streaming dataloader speed significantly fluctuates across batches bug Something isn't working
#686 opened May 25, 2024 by VSehwag
7
Last entry in the dataset is causing "Relative sample index $x is not present" error bug Something isn't working
#677 opened May 20, 2024 by isidentical
3
clean_stale_shared_memory duplicating the master process when called in a train.py script bug Something isn't working
#663 opened Apr 26, 2024 by antoinedandi
2
Support large size index.json (20GB +) enhancement New feature or request
#662 opened Apr 25, 2024 by andreamad8
2
Does it support Preference data (for training Reward / DPO)? enhancement New feature or request
#656 opened Apr 17, 2024 by ericxsun
4
Azure Databricks MDS write ops in error: MapInPandas write_mds gives message Spark higher-order functions are not supported in Unity Catalog bug Something isn't working
#655 opened Apr 15, 2024 by wolliq
2
Out of Memory when using Streaming Dataloader bug Something isn't working
#652 opened Apr 13, 2024 by VikaasVarma
11
Augment existing dataset enhancement New feature or request
#646 opened Apr 3, 2024 by LWprogramming
3
Reuse S3 session enhancement New feature or request
#622 opened Mar 6, 2024 by wouterzwerink
9
Unexpected mds format data for json encoding / how to encode list of strings bug Something isn't working
#613 opened Feb 28, 2024 by ssharpe42
2
Add support for registering custom Cloud Uploaders enhancement New feature or request
#612 opened Feb 28, 2024 by JAEarly
4
ProTip! Adding no:label will show everything without a label.