Added full_refresh attribute to the pipeline_task in `databricks_…

…job` (#2444) This allows to force full refresh of the pipeline from the job. This fixes #2362
databricks · Aug 2, 2023 · 9bb853f · 9bb853f
1 parent bacb45c
commit 9bb853f
Show file tree

Hide file tree

Showing 2 changed files with 3 additions and 1 deletion.
diff --git a/docs/resources/job.md b/docs/resources/job.md
@@ -233,6 +233,7 @@ You can invoke Spark submit tasks only on new clusters. **In the `new_cluster` s
 ### pipeline_task Configuration Block
 
 * `pipeline_id` - (Required) The pipeline's unique ID.
+* `full_refresh` - (Optional) (Bool) Specifies if there should be full refresh of the pipeline.
 
 -> **Note** The following configuration blocks are only supported inside a `task` block
 

diff --git a/jobs/resource_job.go b/jobs/resource_job.go
@@ -60,7 +60,8 @@ type PythonWheelTask struct {
 
 // PipelineTask contains the information for pipeline jobs
 type PipelineTask struct {
-	PipelineID string `json:"pipeline_id"`
+	PipelineID  string `json:"pipeline_id"`
+	FullRefresh bool   `json:"full_refresh,omitempty"`
 }
 
 type SqlQueryTask struct {