py-v0.4.0

See also a blog post announcing this release.

New Features 🪄

• Support for pickling & always manage store prefix by @kylebarron in #185, #239, #223
• Add top-level obstore.store.from_url function, which delegates to each store's from_url constructor by @kylebarron in #179, #201
• Add option to return Arrow from list_with_delimiter by @kylebarron in #238, #244
• (Provisional) Enhanced loading of s3 credentials using aws-config crate by @kylebarron in #203
• Access config values out from stores by @kylebarron in #210
• LocalStore updates:
  • Enable automatic cleanup for local store, when deleting directories by @kylebarron in #175
  • Optionally create root dir in LocalStore by @kylebarron in #177
• File-like object updates:

  • Add support for writable file-like objects by @kylebarron in #167

  • Updates to readable file API:

    • Support user-specified capacity in readable file-like objects by @kylebarron in #174
    • Expose ObjectMeta from readable file API by @kylebarron in #176
• Merge config and kwargs and validate that no configuration parameters have been passed multiple times. (#180, #182, #218)
• Add __repr__ to Bytes class by @jessekrubin in #173

Breaking changes 🔧

• get_range, get_range_async, get_ranges, and get_ranges_async now require named parameters for start, end, and length to make the semantics of the range request fully explicit. by @kylebarron in #156
• Previously, individual stores did not manage a prefix path within the remote resource and PrefixStore was used to enable this. As of 0.4.0, PrefixStore was removed and all stores manage an optional mount prefix natively.
• obstore.open has been renamed to obstore.open_reader.
• The from_env constructor has been removed from S3Store, GCSStore, and AzureStore. Now all constructors will read from environment variables. Use __init__ or from_url instead. #189
• obstore.exceptions.ObstoreError renamed to obstore.exceptions.BaseError #200

Bug fixes 🐛

• Fix pylance finding exceptions module by @kylebarron in #183
• Allow passing in partial retry/backoff config by @kylebarron in #205
• Fix returning None from async functions by @kylebarron in #245
• Fix LocalStore range request past end of file, by @kylebarron in #230

Documentation 📖

• Update wording for fsspec docstring by @kylebarron in #195
• Add documentation about AWS region by @kylebarron in #213
• Add developer documentation for functional API choice by @kylebarron in #215
• Add tqdm progress bar example by @kylebarron in #237
• Add contributor, performance, integrations docs by @kylebarron in #227
• Add minio example by @kylebarron in #241

Other

• Use manylinux 2_24 for aarch64 linux wheels by @kylebarron in #225

New Contributors

• @vincentsarago made their first contribution in #168
• @jessekrubin made their first contribution in #173

Full Changelog: py-v0.3.0...py-v0.4.0