Skip to content

[datafusion-spark] Test integrating datafusion-spark code into comet #1704

@alamb

Description

@alamb

What is the problem the feature request solves?

@shehabgamin added the datafusion-spark crate in apache/datafusion#15168

The goal is to help centralize the development of this function library in the core repository rather than duplicated effort

To verify this is feasible I would like to verify that the setup created in datafusion-spark / apache/datafusion#15168 can be used by downstream crates like comet before we go too far

Describe the potential solution

I would like someone to make a PR that shows we can remove one or more of the spark function in datafusion-spark can be used in comet (and reduce the code here)

Additional context

cc @comphead @andygrove @mbutrovich

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions