You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, I was trying to add a terraform config to some existing jobs/workflows we use. However we use the python script as type and git as source.
This doesn't seem possible to configure using terraform.
Attempted Solutions
For now I can just wrap the script in a notebook file which can use git as source but it would be nice to just run the script.
Proposal
Add support for using spark_python_task with a git_source by adding the "source" field same as notebook_task
References
The text was updated successfully, but these errors were encountered:
Use-cases
Hi, I was trying to add a terraform config to some existing jobs/workflows we use. However we use the python script as type and git as source.
This doesn't seem possible to configure using terraform.
Attempted Solutions
For now I can just wrap the script in a notebook file which can use git as source but it would be nice to just run the script.
Proposal
Add support for using spark_python_task with a git_source by adding the "source" field same as notebook_task
References
The text was updated successfully, but these errors were encountered: