Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Support "source" in resource databricks_job task spark_python_task #2138

Closed
vennsper opened this issue Mar 21, 2023 · 0 comments · Fixed by #2157
Closed

[FEATURE] Support "source" in resource databricks_job task spark_python_task #2138

vennsper opened this issue Mar 21, 2023 · 0 comments · Fixed by #2157
Labels
feature New feature or request

Comments

@vennsper
Copy link

Use-cases

Hi, I was trying to add a terraform config to some existing jobs/workflows we use. However we use the python script as type and git as source.
image
This doesn't seem possible to configure using terraform.

Attempted Solutions

For now I can just wrap the script in a notebook file which can use git as source but it would be nice to just run the script.

Proposal

Add support for using spark_python_task with a git_source by adding the "source" field same as notebook_task

References

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
1 participant