This repository has been archived by the owner on Apr 26, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 26
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat: Vertex AI
CustomJob
worker (#211)
* initial worker commit * Rename the module so we can import/register it; fix command-line formatting * make image required, more comments * tests * docs * remove unneeded defaults * oops * fix test, and rename file * combine to new workers module, fix docs * fix test and rename file * add configurable job spec, schema validation * creds * pass in creds as config variable * remove unneeded checks * fix doc links * set defaults on the variable config * be better at python * logogogogo * all logos * dont get cute --------- Co-authored-by: Chris Guidry <chris.g@prefect.io>
- Loading branch information
1 parent
dfa07ca
commit 6327600
Showing
16 changed files
with
826 additions
and
20 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
::: prefect_gcp.workers.cloud_run |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
::: prefect_gcp.workers.vertex |
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,19 +1,23 @@ | ||
from . import _version | ||
from prefect._internal.compatibility.deprecated import ( | ||
register_renamed_module, | ||
) | ||
|
||
from .bigquery import BigQueryWarehouse # noqa | ||
from . import _version | ||
from .aiplatform import VertexAICustomTrainingJob # noqa | ||
from .cloud_storage import GcsBucket # noqa | ||
from .bigquery import BigQueryWarehouse # noqa | ||
from .cloud_run import CloudRunJob # noqa | ||
from .secret_manager import GcpSecret # noqa | ||
from .cloud_storage import GcsBucket # noqa | ||
from .credentials import GcpCredentials # noqa | ||
from .worker import CloudRunWorker # noqa | ||
from prefect._internal.compatibility.deprecated import ( | ||
register_renamed_module, | ||
) | ||
from .secret_manager import GcpSecret # noqa | ||
from .workers.vertex import VertexAIWorker # noqa | ||
from .workers.cloud_run import CloudRunWorker # noqa | ||
|
||
register_renamed_module( | ||
"prefect_gcp.projects", "prefect_gcp.deployments", start_date="Jun 2023" | ||
) | ||
register_renamed_module( | ||
"prefect_gcp.worker", "prefect_gcp.workers", start_date="Sep 2023" | ||
) | ||
|
||
|
||
__version__ = _version.get_versions()["version"] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Empty file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.