0.9.0
Highlights
- 🌐 Authenticating to different cloud provider with the Local Runner is now simpler through the SDK AWS SageMaker is now supported as an execution framework for Fondant pipelines
| SDK | CLI |
|---|---|
from fondant.pipeline.runner import DockerRunner
from fondant.core.schema import CloudCredentialsMount
runner = DockerRunner()
runner.run(
pipeline_ref="<pipeline_ref>",
auth_provider=CloudCredentialsMount.<GCP,AWS,AZURE>,
) |
fondant run local <pipeline_ref> \
--auth-provider <gcp, aws, azure> |
- 🔍 We made it easier to launch the data explorer in a non-blocking way. This allows you to continue working in your notebook while the explorer is running in the background.
🚥 RAG Component updates
New components 🚀
- AWS opensearch indexing component
- Component to load PDF data from local or remote storage. More info here
Updates on existing components 🛠️
- Generalizing the text chunker component to use different chunking techniques. More info here
🛠 Install it now!
pip install fondant==0.9.0And let us know what you think!
What's Changed
- Update README.md by @CarolineAdam in #726
- Sagemaker doc small update by @PhilippeMoussalli in #733
- Add logs to weaviate by @PhilippeMoussalli in #734
- Revert broken test link by @PhilippeMoussalli in #739
- Add missing explorer screenshots by @PhilippeMoussalli in #743
- Fix retry mechanism embedding component by @PhilippeMoussalli in #736
- Minor adjustments pipeline docstring by @mrchtr in #738
- Update generic readme generation by @PhilippeMoussalli in #737
- Consistent component naming by @PhilippeMoussalli in #745
- Make data explorer non-blocking with docker compose by @PhilippeMoussalli in #731
- Include information on dynamic fields by @PhilippeMoussalli in #744
- Unify operation and component spec by @PhilippeMoussalli in #741
- Add component to index aws opensearch by @shub-kris in #740
- Add named links to hub page by @PhilippeMoussalli in #746
- Propagate dataset schema eagerly by @RobbeSneyders in #748
- Generalize chunk data component by @PhilippeMoussalli in #757
- Accept actual type instead of string representation in Argument class by @RobbeSneyders in #761
- Add env var to force amd platform on docker runner by @GeorgesLorre in #760
- Fix readme generation by @RobbeSneyders in #764
- Add component argument inference by @RobbeSneyders in #763
- Add teardown method by @PhilippeMoussalli in #767
- Add load from pdf component by @PhilippeMoussalli in #765
- Fix ragas component by @PhilippeMoussalli in #759
- Fixing data type in chunk_text component by @mrchtr in #772
- Add teardown method to components by @PhilippeMoussalli in #773
- Handle docker compose errors by @PhilippeMoussalli in #769
- Move integration test into examples by @mrchtr in #756
- Add availability check for docker and docker compose. by @mrchtr in #742
- Fixes by @PhilippeMoussalli in #776
- Move cloud auth to sdk by @PhilippeMoussalli in #779
- Fix load from pdf component by @PhilippeMoussalli in #778
- Fix typo ragas by @PhilippeMoussalli in #781
- Add RAG blogpost announcement by @mrchtr in #777
- Handle nested strings in explorer by @PhilippeMoussalli in #766
New Contributors
- @CarolineAdam made their first contribution in #726
- @shub-kris made their first contribution in #740
Full Changelog: 0.8.0...0.9.0
Contributors
mrchtr, shub-kris, and 4 other contributors