18 Apr 13:35

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

Upgrade to v0.32

OpenDAL 0.32 doesn't have much breaking changes.

We changed Accessor::create into Accessor::create_dir. Only users who implement Layer need to change.

v0.32.0 - 2023-04-18

Added

feat: Add wasabi service implementation (#2004)
feat: improve the readability of oli command line error output (#2016)
feat: add If-Match Support for OpRead, OpWrite, OpStat (#2017)
feat: add behavioral test for Write::abort (#2018)
feat: add if-match support for obs (#2023)
feat: Add missing functions for trace layers (#2025)
feat(layer): add madsim layer (#2006)
feat(gcs): add support for gcs append (#1801)

Changed

refactor: Rename Create to CreateDir for its behavior changed (#2019)

Fixed

fix: Cargo lock not updated (#2027)
fix(services/s3): Ignore empty query to make it more compatible (#2028)
fix(services/oss): Fix env not loaded for oss signer (#2029)

Docs

docs: fix some typos (#2022)
docs: add dev dependency section (#2021)

New Contributors

@czybjtu made their first contribution in #2016
@Yansongsongsong made their first contribution in #2022
@haohuaijin made their first contribution in #2023
@SkyFan2002 made their first contribution in #2006
@cuichenli made their first contribution in #1801

Full Changelog: v0.31.1...v0.32.0

Contributors

Gnosnay, cuichenli, and 3 other contributors

Assets 6

0 Join discussion

16 Apr 16:25

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

v0.31.1 - 2023-04-17

Added

feat(services/azdfs): support rename (#1929)
test: Increate copy/move nested path test depth (#1932)
feat(layers): add a basic minitrace layer (#1931)
feat: add Writer::abort method (#1937)
feat(services/gcs): Allow setting PredefinedAcl (#1989)
feat(services/oss): add oss cache-control header support (#1986)
feat: Add PreconditionFailed Error so users can handle them (#1993)
feat: add http if_none_match support (#1995)
feat: add oss if-none-match support (#1997)
feat(services/gcs): Allow setting default storage_class (#1996)
feat(binding/C): add clang-format for c binding (#2003)

Changed

refactor: Polish the behavior of scan (#1926)
refactor: Polish the implementation of webhdfs (#1935)

Fixed

fix: sled should not be enabled by default (#1923)
fix: kv adapter's writer implementation fixed to honour empty writes (#1934)
fix(services/azblob): fix copy missing content-length (#2000)

Docs

docs: Adding docs link to python binding (#1921)
docs(bindings/python): fix wrong doc link (#1928)
docs: Add contributing for OpenDAL (#1984)
docs: Add explanation in contributing (#1985)
docs: Feel relax in community and don't hurry (#1987)
docs: update contributing (#1998)
docs(services/memory): Fix wrong explanation (#2002)
docs: Add OpenDAL VISION (#2007)
docs: update VISION and behavior tests doc (#2009)

CI

ci(bindings/nodejs): Access should be set to public before publish (#1919)
ci: Re-enable webhdfs test (#1925)
chore: add .editorconfig (#1988)
ci: Fix format after adding editorconfig (#1990)

New Contributors

@sa- made their first contribution in #1921
@ahonn made their first contribution in #1988
@silver-ymz made their first contribution in #1989
@Nickqiaoo made their first contribution in #1995
@thorseraq made their first contribution in #1997

Full Changelog: v0.31.0...v0.31.1

Contributors

sa-, ahonn, and 3 other contributors

Assets 6

0 Join discussion

12 Apr 03:52

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

Upgrade to v0.31

In version v0.31 of OpenDAL, we made some internal refactoring to improve its compatibility with the ecosystem.

MSRV Bump

We increased the MSRV to 1.64 from v0.31 onwards. Although it is still possible to build OpenDAL under older rustc versions, we cannot guarantee that any issues related to them will be fixed.

Accept `std::time::Duration` instead

Previously, OpenDAL accepted time::Duration as input for presign_xxx. However, since v0.31, we have changed this to accept std::time::Duration so that users do not need to depend on time. Internally, we migrated from time to chrono for better integration with other parts of the ecosystem.

`disable_ec2_metadata` for services s3

We have added a new configuration option called disable_ec2_metadata for the S3 service in response to a mistake where it was mixed up with another option called disable_config_load. Users who want to disable loading credentials from EC2 metadata should set this option instead.

Services Feature Flag

Starting from v0.31, all services in OpenDAL are split into different feature flags. To enable only S3 support, use the following TOML configuration:

opendal = {
    version = "0.31",
    default-features = false,
    features = ["services-s3"]
}

v0.31.0 - 2023-04-12

Added

feat(bindings/java): add cucumber test (#1809)
feat(bindings/java): setup Java CI (#1823)
feat: add if_none_match support (#1832)
feat: Retry when some of batch operations are failing (#1840)
feat: add writer support for aliyun oss (#1842)
feat(core): Add Copy Support (#1841)
feat(bindings/c): fix c bindings makefile (#1849)
feat(core): add behavior tests for copy & blocking_copy (#1852)
feat(s3): allow users to specify storage_class (#1854)
feat(s3): Support copy (#1856)
Add check for s3 bucket name (#1857)
feat(core): Support rename (#1862)
feat(bindings/nodejs): add copy and rename (#1866)
feat(azblob): Support copy (#1868)
feat(gcs): copy support for GCS (#1869)
feat(bindings/c): framework of add basic io and init logics (#1861)
feat(webdav): support copy (#1870)
feat(services/oss): Add Copy Support (#1874)
feat(services/obs): Add Copy Support (#1876)
feat(services/webdav): Support Rename (#1878)
binding/c: parse opendal to use typed BlockingOperator (#1881)
binding/c: clean up comments and type assertion for BlockingOperator (#1883)
binding(python): Support python binding benchmark for opendal (#1882)
feat(bindings/c): add support for free heap-allocated operator (#1890)
feat(binding/c): add is_exist to operator (#1892)
feat(bindings/java): add Stat support (#1894)
feat(services/gcs): Add customed token loader support (#1908)
feat(services/oss): remove unused builder prop allow_anonymous (#1913)
feat: Add feature flag for all services (#1915)

Changed

refactor(core): Simplify the usage of BatchOperation and BatchResults (#1843)
refactor: Use reqwest blocking client instead of ureq (#1853)
refactor: Bump MSRV to 1.64 (#1864)
refactor: Remove not used blocking http client (#1895)
refactor: Change presign to async for future refactor (#1900)
refactor(services/gcs): Migrate to async reqsign (#1906)
refactor(services/azdfs): Migrate to async reqsign (#1903)
refactor(services/azblob): Adopt new reqsign (#1902)
refactor(services/s3): Migrate to async reqsign (#1909)
refactor(services/oss): Migrate to async reqsign (#1911)
refactor: Use chrono instead of time to work well with ecosystem (#1912)
refactor(service/obs): Migrate obs to async reqsign (#1914)

Fixed

fix: podling website check (#1838)
fix(website): copyright update (#1839)
fix(core): Add checks before doing copy (#1845)
fix(core): S3 Copy should set SSE headers (#1860)
fix: Fix presign related unit tests (#1910)

Docs

docs(bindings/nodejs): fix build failed (#1819)
docs: fix several typos in the documentation (#1846)
doc(bindings/nodejs): update presign example in doc (#1901)

CI

ci: Fix build for nodejs binding on macos (#1813)
binding/c: build: add phony to makefile, and some improve (#1850)
ci: upgrade hawkeye action (#1834)

Chore

chore(bindings/nodejs): add deno benchmark (#1814)
chore: Add CODEOWNERS (#1817)
chore(deps): bump opentelemetry-jaeger from 0.16.0 to 0.18.0 (#1829)
chore(deps): bump opentelemetry from 0.17.0 to 0.19.0 (#1830)
chore(deps): bump tokio from 1.26.0 to 1.27.0 (#1828)
chore(deps): bump napi-derive from 2.12.1 to 2.12.2 (#1827)
chore(deps): bump async-trait from 0.1.67 to 0.1.68 (#1826)
chore: Cleanup code for oss writer (#1847)
chore: Make clippy happy (#1865)
binding(python): Format python code in binding (#1885)

New Contributors

@gitccl made their first contribution in #1832
@v0y4g3r made their first contribution in #1842
@Ji-Xinyou made their first contribution in #1846
@darknight made their first contribution in #1857
@Zheaoli made their first contribution in #1882

Full Changelog: v0.30.5...v0.31.0

Contributors

darknight, v0y4g3r, and 3 other contributors

Assets 5

0 Join discussion

31 Mar 02:14

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

v0.30.5 - 2023-03-31

Added

feat(oli): implement oli rm (#1774)
feat(bindings/nodejs): Support presign (#1772)
feat(oli): implement oli stat (#1778)
feat(bindings/object_store): Add support for list and list_with_delimiter (#1784)
feat(oli): implement oli cp -r (#1787)
feat(bindings/nodejs): Make PresignedRequest serializable (#1797)
feat(binding/c): add build.rs and cbindgen as dep to gen header (#1793)
feat(bindings/nodejs): Add more APIs and examples (#1799)
feat: reader_with and writer_with (#1803)
feat: add override_cache_control (#1804)
feat: add cache_control to OpWrite (#1806)

Changed

refactor(oli): switch to Operator::scan and Operator::remove_all (#1779)
refactor(bindings/nodejs): Polish benchmark to make it more readable (#1810)

Fixed

fix(oli): set the root of fs service to '/' (#1773)
fix: align WebDAV stat with RFC specification (#1783)
fix(bindings/nodejs): fix read benchmark (#1805)

CI

ci: Split clippy and docs check (#1785)
ci(bindings/nodejs): Support aarch64-apple-darwin (#1780)
ci(bindings/nodejs): publish with LICENSE & NOTICE (#1790)
ci(services/redis): Add dragonfly test (#1808)

Chore

chore(bindings/python): update maturin to 0.14.16 (#1777)
chore(bin/oli): Set oli version from package version (#1786)
chore(oli): set cli version in a central place (#1789)
chore: don't pin time version (#1788)
chore(bindings/nodejs): init benchmark (#1798)
chore(bindings/nodejs): Fix generated headers (#1802)

New Contributors

@bxb100 made their first contribution in #1783
@nasen23 made their first contribution in #1784
@promer94 made their first contribution in #1798

Full Changelog: v0.30.4...v0.30.5

Contributors

promer94, bxb100, and nasen23

Assets 5

0 Join discussion

25 Mar 17:09

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

v0.30.4 - 2023-03-26

Added

feat(oli): add config file to oli (#1706)
feat: make oli support more services (#1717)
feat(bindings/ruby): Setup the integrate with magnus (#1712)
feat(bindings/ruby): setup cucumber tests (#1725)
feat(bindings/python): convert to mixed Python/Rust project layout (#1729)
RFC-1735: Operation Extension (#1735)
feat(oli): load config from both env and file (#1737)
feat(bindings/ruby): support read and write (#1734)
feat(bindings/ruby): support stat, and pass all blocking bdd test (#1743)
feat(bindings/ruby): add namespace (#1745)
feat: Add override_content_disposition for OpRead (#1742)
feat(bindings/java): add java binding (#1736)
feat(oli): implement oli ls (#1755)
feat(oli): implement oli cat (#1759)

Fixed

fix(bindings/nodejs): Publish sub-package name (#1704)

Docs

docs: Update comparison vs object_store (#1698)
docs(bindings/python): add pdoc to docs env (#1718)
docs: List working on bindings in README (#1753)

CI

ci: Fix workflow not triggered when itself changed (#1716)
ci: Remove ROCKSDB_LIB_DIR after we didn't install librocksdb (#1719)
ci: Fix nodejs built failed for "Unexpected token o in JSON at position 0" (#1722)
ci: Split cache into more parts (#1730)
ci: add a basic ci for ruby (#1744)
ci: Remove target from cache (#1764)

Chore

chore: Fix CHANGELOG not found (#1694)
chore: Remove publish=false of oli (#1697)
chore: Fix a few typos in code comment (#1701)
chore(bindins/nodejs): Update README (#1709)
chore: rename binaries to bin (#1714)
chore: bump rocksdb to resolve dependency conflicts with magnus (#1713)
chore(bindings/nodejs): Remove outdated napi patches (#1727)
chore: Add CITATION file for OpenDAL (#1746)
chore: improve NotADirectory error message with ending slash (#1756)
chore(bindings/python): update pyo3 to 0.18.2 (#1758)

New Contributors

@viirya made their first contribution in #1701
@knight42 made their first contribution in #1706
@kidylee made their first contribution in #1736

Full Changelog: v0.30.3...v0.30.4

Contributors

viirya, kidylee, and knight42

Assets 5

0 Join discussion

20 Mar 03:08

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

v0.30.3 - 2023-03-20

Added

feat: Infer storage name based on endpoint (#1551)
feat(bindings/python): implement async file-like reader API (#1570)
feat: website init (#1580)
feat(bindings/python): implement list and scan for AsyncOperator (#1586)
feat: Implement logging/metrics/tracing support for Writer/BlockingWriter (#1588)
feat(bindings/python): expose layers to Python (#1591)
feat(bindings/c): Setup the integrate with cbindgen (#1603)
feat(bindings/nodejs): Auto-generate docs (#1625)
feat: add max_batch_operations for AccessorInfo (#1615)
feat(azblob): Add support for batch operations (#1610)
services/redis: Implement Write::append with native support (#1651)
feat(tests): Introducing BDD tests for all bindings (#1654)
feat(bindings/nodejs): Migrate to BDD test (#1661)
feat(bindings/nodejs): Add generated index.d.ts (#1664)
feat(bindings/python): add auto-generated api docs (#1613)
feat(bindings/python): add __repr__ to Operator and AsyncOperator (#1683)

Changed

*: Change all files licenses to ASF (#1592)
refactor(bindings/python): only enable pyo3/entension-module feature when building with maturin (#1680)

Fixed

fix(bindings/python): Fix the metadata for Python binding (#1568)
fix: Operator::remove_all behaviour on non-existing object fixed (#1587)
fix: reset Reader::SeekState when poll completed (#1609)
fix: Bucket config related error is misleadling (#1684)
fix(services/s3): UploadId should be percent encoded (#1690)

CI

ci: Fix typo in workflows (#1582)
ci: Don't check dep updates so frequently (#1599)
ci: Setup asf config (#1622)
ci: Use gh-pages instead (#1623)
ci: Update Github homepage (#1627)
ci: Update description for OpenDAL (#1628)
ci: Send notifications to commits@o.a.o (#1629)
ci: set main branch to be protected (#1631)
ci: Add release scripts for OpenDAL (#1637)
ci: Add check scripts (#1638)
ci: Remove rust-cache to allow we can test rust code now (#1643)
ci: Enable license check back (#1663)
ci(bindings/nodejs): Enable formatter (#1665)
ci: Bring our actions back (#1668)
ci: Use korandoru/hawkeye@v1.5.4 instead (#1672)
ci: Fix license header check and doc check (#1674)
infra: Add odev to simplify contributor's setup (#1687)

Docs

docs: Migrate links to o.a.o (#1630)
docs: update the old address and the LICENSE size. (#1633)
doc: update doc-link (#1642)
docs(blog): Way to Go: OpenDAL successfully entered Apache Incubator (#1652)
docs: Reorganize README of core and whole project (#1676)
doc: Update README.md for quickstart (#1650)
doc: uncomment the use expr for operator example (#1685)

Website

website: Let's deploy our new website (#1581)
website: Fix CNAME not set (#1590)
website: Fix website publish (#1626)
website: Add GitHub entry (#1636)
website: move some content of footer to navbar. (#1660)

Chore

chore(bindings/nodejs): fix missing files to publish (#1569)
chore(deps): bump lazy-regex from 2.4.1 to 2.5.0 (#1573)
chore(deps): bump tokio from 1.25.0 to 1.26.0 (#1577)
chore(deps): bump hyper from 0.14.24 to 0.14.25 (#1575)
chore(deps): bump serde from 1.0.152 to 1.0.155 (#1576)
chore(deps): bump peaceiris/actions-gh-pages from 3.9.0 to 3.9.2 (#1593)
chore(deps): bump async-trait from 0.1.64 to 0.1.66 (#1594)
chore(deps): bump serde_json from 1.0.93 to 1.0.94 (#1596)
chore(deps): bump paste from 1.0.11 to 1.0.12 (#1598)
chore(deps): bump napi from 2.11.2 to 2.11.3 (#1595)
chore(deps): bump serde from 1.0.155 to 1.0.156 (#1600)
chore: fix the remaining license (#1605)
chore: add a basic workflow for c bindings (#1608)
chore: manage deps with maturin (#1611)
chore: Rename files to yaml (#1624)
chore: remove PULL_REQUEST_TEMPLATE (#1634)
chore: add NOTICE and DISCLAIMER (#1635)
chore(operator): apply max_batch_limit for async operator (#1641)
chore: replace datafuselabs/opendal with apache/incubator-opendal (#1647)
chore: make check.sh be executable and update gitignore (#1648)
chore(automation): fix release.sh packaging sha512sum (#1649)
chore: Update metadata (#1666)
chore(website): Remove authors.yml (#1669)
chore: Move opendal related staffs to core (#1673)
chore: Remove not needed ignore from licenserc (#1677)
chore: Ignore generated docs from git (#1686)

New Contributors

@xinlifoobar made their first contribution in #1551
@flisky made their first contribution in #1609
@tao12345666333 made their first contribution in #1631
@tzssangglass made their first contribution in #1633
@ZHOUSH41 made their first contribution in #1684
@xunfeng1980 made their first contribution in #1650
@zwpaper made their first contribution in #1685

Full Changelog: v0.30.2...v0.30.3

Contributors

flisky, tao12345666333, and 5 other contributors

Assets 5

0 Join discussion

10 Mar 13:19

What's Changed

ci(bindings/nodejs): Fix nodejs package can't uploaded by @Xuanwo in #1564
Bump to version 0.30.2 by @Xuanwo in #1565

Full Changelog: v0.30.1...v0.30.2

Contributors

Xuanwo

Assets 5

0 Join discussion

10 Mar 11:24

What's Changed

chore(bindings/nodejs): update license in package.json by @suyanhanx in #1556
ci: Fix python & nodejs not released correctly by @Xuanwo in #1559
docs: Fix Operator::create() has been removed by @Xuanwo in #1560
Bump to version 0.30.1 by @Xuanwo in #1561

Full Changelog: v0.30.0...v0.30.1

Contributors

Xuanwo and suyanhanx

Assets 2

0 Join discussion

10 Mar 10:37

Upgrade to v0.30

In version 0.30, we made significant breaking changes by removing objects. Our goal in doing so was to provide our users with APIs that are easier to understand and maintain.

More detailes could be found at [RFC: Remove Object Concept][crate::docs::rfcs::rfc_1477_remove_object_concept].

To upgrade to OpenDAL v0.30, users need to make the following changes:

regex replace object\((.*)\).reader\(\) to reader($1)
- replace the function on your case, it's recomanded to do it one by one
rename ObjectMetakey => Metakey
rename ObjectMode => EntryMode
replace ErrorKind::ObjectXxx to ErrorKind::Xxx
rename AccessorMetadata => AccessorInfo
rename ObjectMetadata => Metadata
replace operator.metadata() => operator.info()

What's Changed

refactor: Split operator APIs into different part by @Xuanwo in #1483
RFC-1477: Remove Object Concept by @Xuanwo in #1477
feat(bindings/nodejs): fs Operator by @suyanhanx in #1485
refactor: Remove Object prefix for public API by @Xuanwo in #1488
chore: Re-organize the project layout by @Xuanwo in #1489
refactor: Remove the concept of Object by @Xuanwo in #1496
fix(services/s3): Make sure the ureq's body has been consumed by @Xuanwo in #1497
feat(service/dashmap): Add scan support by @suyanhanx in #1492
ci: Don't run binding tests if only services changes by @Xuanwo in #1498
chore: typo & clippy by @suyanhanx in #1499
feat(bindings/nodejs): Add Writer Support by @suyanhanx in #1490
docs: Remove all references to object by @Xuanwo in #1500
chore: typo by @suyanhanx in #1501
ci: Improve rocksdb build speed by link dynamic libs by @Xuanwo in #1502
feat: Add dummy implementation for accessor and builder by @Xuanwo in #1503
refactor: remove ReadDir in FTP service by @PragmaTwice in #1504
feat(bindings/nodejs): Support List & append all default services by @suyanhanx in #1505
feat(bindings/python): Setup operator init logic by @Xuanwo in #1513
refactor: rename public api create to create_dir by @suyanhanx in #1512
refactor(bindings/python): return bytes directly and add type stub file by @messense in #1514
tests: Remove not needed create file test by @Xuanwo in #1516
feat(bindings/nodejs): write support string by @suyanhanx in #1520
refactor: improve the python binding implementation by @frostming in #1517
feat(bindings/python): add support for services that opendal enables by default by @messense in #1522
docs(bindings/python): Add building docs by @Xuanwo in #1526
docs(bindings/nodejs): update readme by @suyanhanx in #1527
feat(bindings/nodejs): Remove Operator.writer until we are ready by @suyanhanx in #1528
ci: Fix bindings CI not running on PR by @Xuanwo in #1530
fix(services/s3): Allow retry error RequestTimeout by @Xuanwo in #1532
feat(bindings/nodejs): Support Operator.create_dir by @suyanhanx in #1529
docs: Add detailed docs for create_dir by @Xuanwo in #1537
feat(bindings/python): implement create_dir by @messense in #1534
feat(bindings/python): implement delete and export more metadata fields by @messense in #1539
feat(bindings/python): implement blocking list and scan by @messense in #1541
feat: Append EntryMode to Entry by @suyanhanx in #1543
chore: Move memcache-async into opendal by @Xuanwo in #1544
feat: Entry refactoring to allow external creation by @damooo in #1547
feat(bindings/nodejs): Support Operator.scanSync & Operator.listSync by @suyanhanx in #1546
feat: remove_via can delete files concurrently by @uran0sH in #1495
refactor(bindings/nodejs): Remove scheme from bindings by @Xuanwo in #1552
ci: Polish scripts and prepare for releasing by @Xuanwo in #1553
feat(bindings/python): implement blocking file-like reader API by @messense in #1554
Bump OpenDAL to 0.30 by @Xuanwo in #1555

New Contributors

@PragmaTwice made their first contribution in #1504
@frostming made their first contribution in #1517
@uran0sH made their first contribution in #1495

Full Changelog: v0.29.1...v0.30.0

Contributors

messense, Xuanwo, and 5 other contributors

Assets 2

0 Join discussion

05 Mar 09:08

What's Changed

docs: Add convert from m*n to m+n by @Xuanwo in #1454
docs: Polish comments for public types by @Xuanwo in #1455
chore: fix typo by @jackwener in #1456
chore: fix typo by @suyanhanx in #1459
benches: Generate into Bytes instead by @Xuanwo in #1463
feat(bindings/python): Add basic IO support by @Xuanwo in #1464
feat(binding/node.js): basic IO by @suyanhanx in #1416
chore(bindings/nodjes): Don't check-in binaries by @Xuanwo in #1469
chore(binding/nodejs): specific package manager version with hash by @suyanhanx in #1470
docs: Add discord chat link by @Xuanwo in #1474
feat(bindings/nodejs): Align to OpenDAL exports by @suyanhanx in #1466
chore(bindings/nodejs): remove duplicate attribute & unused comment by @suyanhanx in #1478
refactor: Promote operator as a mod for futher refactor by @Xuanwo in #1479
Bump to version 0.29.1 by @Xuanwo in #1481

New Contributors

@suyanhanx made their first contribution in #1459

Full Changelog: v0.29.0...v0.29.1

Contributors

Xuanwo, suyanhanx, and jackwener

Assets 2

0 Join discussion