Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions airflow-core/tests/unit/always/test_project_structure.py
Original file line number Diff line number Diff line change
Expand Up @@ -428,6 +428,7 @@ class TestGoogleProviderProjectStructure(ExampleCoverageTest, AssetsCoverageTest
"airflow.providers.google.cloud.operators.automl.AutoMLDeleteModelOperator",
"airflow.providers.google.cloud.operators.automl.AutoMLListDatasetOperator",
"airflow.providers.google.cloud.operators.automl.AutoMLDeleteDatasetOperator",
"airflow.providers.google.cloud.operators.vertex_ai.auto_ml.CreateAutoMLVideoTrainingJobOperator",
"airflow.providers.google.cloud.operators.bigquery.BigQueryCreateEmptyTableOperator",
"airflow.providers.google.cloud.operators.bigquery.BigQueryCreateExternalTableOperator",
"airflow.providers.google.cloud.operators.datapipeline.CreateDataPipelineOperator",
Expand Down
29 changes: 11 additions & 18 deletions providers/google/docs/operators/cloud/vertex_ai.rst
Original file line number Diff line number Diff line change
Expand Up @@ -265,36 +265,22 @@ put dataset id to ``dataset_id`` parameter in operator.
:start-after: [START how_to_cloud_vertex_ai_create_auto_ml_tabular_training_job_operator]
:end-before: [END how_to_cloud_vertex_ai_create_auto_ml_tabular_training_job_operator]

.. warning::
This operator is deprecated and will be removed after March 24, 2026. Please use
:class:`~airflow.providers.google.cloud.operators.vertex_ai.generative_model.SupervisedFineTuningTrainOperator`.

How to run AutoML Video Training Job
:class:`~airflow.providers.google.cloud.operators.vertex_ai.auto_ml.CreateAutoMLVideoTrainingJobOperator`

Before start running this Job you must prepare and create ``Video`` dataset. After that you should
put dataset id to ``dataset_id`` parameter in operator.

.. exampleinclude:: /../../google/tests/system/google/cloud/vertex_ai/example_vertex_ai_auto_ml_video_training.py
:language: python
:dedent: 4
:start-after: [START how_to_cloud_vertex_ai_create_auto_ml_video_training_job_operator]
:end-before: [END how_to_cloud_vertex_ai_create_auto_ml_video_training_job_operator]

Additionally, you can create new version of existing AutoML Video Training Job. In this case, the result will be new
version of existing Model instead of new Model created in Model Registry. This can be done by specifying
``parent_model`` parameter when running AutoML Video Training Job.

.. exampleinclude:: /../../google/tests/system/google/cloud/vertex_ai/example_vertex_ai_auto_ml_video_training.py
:language: python
:dedent: 4
:start-after: [START how_to_cloud_vertex_ai_create_auto_ml_video_training_job_v2_operator]
:end-before: [END how_to_cloud_vertex_ai_create_auto_ml_video_training_job_v2_operator]

Also you can use vertex_ai AutoML model for video tracking.

.. exampleinclude:: /../../google/tests/system/google/cloud/vertex_ai/example_vertex_ai_auto_ml_video_tracking.py
:language: python
:dedent: 4
:start-after: [START how_to_cloud_vertex_ai_create_auto_ml_video_tracking_job_operator]
:end-before: [END how_to_cloud_vertex_ai_create_auto_ml_video_tracking_job_operator]


You can get a list of AutoML Training Jobs using
:class:`~airflow.providers.google.cloud.operators.vertex_ai.auto_ml.ListAutoMLTrainingJobOperator`.
Expand Down Expand Up @@ -620,6 +606,13 @@ The operator returns the tuned model's endpoint name in :ref:`XCom <concepts:xco
:start-after: [START how_to_cloud_vertex_ai_supervised_fine_tuning_train_operator]
:end-before: [END how_to_cloud_vertex_ai_supervised_fine_tuning_train_operator]

You can also use supervised fine tuning job for video tasks: training and tracking

.. exampleinclude:: /../../google/tests/system/google/cloud/vertex_ai/example_vertex_ai_generative_model_tuning.py
:language: python
:dedent: 4
:start-after: [START how_to_cloud_vertex_ai_supervised_fine_tuning_train_operator_for_video]
:end-before: [END how_to_cloud_vertex_ai_supervised_fine_tuning_train_operator_for_video]

To calculates the number of input tokens before sending a request to the Gemini API you can use:
:class:`~airflow.providers.google.cloud.operators.vertex_ai.generative_model.CountTokensOperator`.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -29,13 +29,15 @@
from google.cloud.aiplatform.models import Model
from google.cloud.aiplatform_v1.types.training_pipeline import TrainingPipeline

from airflow.exceptions import AirflowProviderDeprecationWarning
from airflow.providers.google.cloud.hooks.vertex_ai.auto_ml import AutoMLHook
from airflow.providers.google.cloud.links.vertex_ai import (
VertexAIModelLink,
VertexAITrainingLink,
VertexAITrainingPipelinesLink,
)
from airflow.providers.google.cloud.operators.cloud_base import GoogleCloudBaseOperator
from airflow.providers.google.common.deprecated import deprecated

if TYPE_CHECKING:
from google.api_core.retry import Retry
Expand Down Expand Up @@ -473,6 +475,11 @@ def execute(self, context: Context):
return result


@deprecated(
planned_removal_date="March 24, 2026",
use_instead="airflow.providers.google.cloud.operators.vertex_ai.generative_model.SupervisedFineTuningTrainOperator",
category=AirflowProviderDeprecationWarning,
)
class CreateAutoMLVideoTrainingJobOperator(AutoMLTrainingJobBaseOperator):
"""Create Auto ML Video Training job."""

Expand Down

This file was deleted.

Loading
Loading