[Feature] Single Pypi package for python, ray and spark and single pypi package for all transforms

[touma-I]

Search before asking

• I searched the issues and found no similar issues.

Component

Library/core, Transforms/Other

Feature

The current model for releasing the runtime and the transforms create a different package such as::

• data-prep-toolkit, data-prep-toolkit_ray, data-prep-transforms, data-prep-transfroms-ray, etc

We propose deploying a single package for all libraries/runtimes and a single package for all transforms with dependencies as follow:

• data-prep-toolkit[ray, spark]
• data-prep-transform[all, ray, spark, pdf2parquet, doc_id, doc_chunk, etc.]

Are you willing to submit a PR?

• Yes I am willing to submit a PR!