v0.8.0

What's changed

Added

• Add multi-modal transformers (huggingface-embedding) with windowing options
• Add render_page option to pdfminer extractor, for multi-modal PDF features
• Add inference utilities (accelerators), with simple mono process support and multi gpu / cpu support
• Packaging utils (pipeline.package(...)) to make a pip installable package from a pipeline

Changed

• Updated API to follow EDS-NLP's refactoring
• Updated confit to 0.4.2 (better errors) and foldedtensor to 0.3.0 (better multiprocess support)
• Removed pipeline.score. You should use pipeline.pipe, a custom scorer and pipeline.select_pipes instead.
• Better test coverage
• Use hatch instead of setuptools to build the package / docs and run the tests

Fixed

• Fixed attrs dependency only being installed in dev mode

Pull Requests

• Huggingface multi-modal transformers by @percevalw in #15
• Dev install documentation and dependencies fix by @ian-fox in #16
• Huggingface by @percevalw in #17
• Accelerators by @percevalw in #19
• Scoring by @percevalw in #20
• Packaging utils by @percevalw in #18
• chore: bump version to 0.8.0 by @percevalw in #21
• feat: switch to hatch package manager by @percevalw in #22

New Contributors

• @ian-fox made their first contribution in #16

Full Changelog: v0.7.0...v0.8.0