Add top-level access to FlyteRemote, FlyteFile, and FlyteDirectory and convenience class methods for FlyteRemote #2836
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
granthamtaylor
requested review from
wild-endeavor,
kumare3,
eapolinario,
pingsutw,
cosmicBboy,
samhita-alla,
thomasjpfan and
Future-Outlier
as code owners
kumare3
approved these changes
Oct 18, 2024
|
Can we update our documentation to use these changes? |
granthamtaylor
added a commit
that referenced
this pull request
Oct 21, 2024
* Catch mistake in structured dataset (#2834) Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Small change to clean up unit test. (#2835) * delete=true Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * close but don't delete on close Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * skip for 3.9 Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * 10 Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> --------- Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Fix tree printing (#2837) Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * handle case where error may not have args (#2831) Signed-off-by: Blake Jackson <blake@BB8.local> Co-authored-by: Blake Jackson <blake@BB8.local> * Bump pyspark from 3.3.1 to 3.3.2 in /plugins/flytekit-greatexpectations (#2818) Bumps [pyspark](https://github.com/apache/spark) from 3.3.1 to 3.3.2. - [Commits](apache/spark@v3.3.1...v3.3.2) --- updated-dependencies: - dependency-name: pyspark dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Pull secrets from environment when running locally (#2800) Signed-off-by: Thomas J. Fan <thomasjpfan@gmail.com> * Support executing launchplans from CLI (#2839) Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com> Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com> * Add top-level access to FlyteRemote, FlyteFile, and FlyteDirectory and convenience class methods for FlyteRemote (#2836) --------- Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> Signed-off-by: Blake Jackson <blake@BB8.local> Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Thomas J. Fan <thomasjpfan@gmail.com> Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com> Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> Co-authored-by: Blake Jackson <blaketastic2@gmail.com> Co-authored-by: Blake Jackson <blake@BB8.local> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Thomas J. Fan <thomasjpfan@gmail.com> Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com> Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com>
|
Hi Thomas, yes I will update these docs |
granthamtaylor
added a commit
that referenced
this pull request
Oct 22, 2024
* Catch mistake in structured dataset (#2834) Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Small change to clean up unit test. (#2835) * delete=true Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * close but don't delete on close Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * skip for 3.9 Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * 10 Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> --------- Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Fix tree printing (#2837) Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * handle case where error may not have args (#2831) Signed-off-by: Blake Jackson <blake@BB8.local> Co-authored-by: Blake Jackson <blake@BB8.local> * Bump pyspark from 3.3.1 to 3.3.2 in /plugins/flytekit-greatexpectations (#2818) Bumps [pyspark](https://github.com/apache/spark) from 3.3.1 to 3.3.2. - [Commits](apache/spark@v3.3.1...v3.3.2) --- updated-dependencies: - dependency-name: pyspark dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Pull secrets from environment when running locally (#2800) Signed-off-by: Thomas J. Fan <thomasjpfan@gmail.com> * Support executing launchplans from CLI (#2839) Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com> Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com> * Add top-level access to FlyteRemote, FlyteFile, and FlyteDirectory and convenience class methods for FlyteRemote (#2836) * Config for_endpoint doesn't respect config file (#2843) Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * Union/enum handling (#2845) * temp Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * delete test Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * allow strings Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * remove enum transformer change and tests Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * reset a test Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * lint Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * use .value for enums to handle dynamic case Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * use prior logic for 3.9 Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * add 3.9 testing Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * should always be a union type Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> --------- Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * update docs for FlyteRemote (#2847) --------- Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> Signed-off-by: Blake Jackson <blake@BB8.local> Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Thomas J. Fan <thomasjpfan@gmail.com> Signed-off-by: Ketan Umare <kumare3@users.noreply.github.com> Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> Co-authored-by: Blake Jackson <blaketastic2@gmail.com> Co-authored-by: Blake Jackson <blake@BB8.local> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Thomas J. Fan <thomasjpfan@gmail.com> Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com> Co-authored-by: Ketan Umare <kumare3@users.noreply.github.com>
eapolinario
pushed a commit
that referenced
this pull request
Nov 5, 2024
…d convenience class methods for FlyteRemote (#2836) Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
kumare3
pushed a commit
that referenced
this pull request
Nov 8, 2024
…d convenience class methods for FlyteRemote (#2836)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
FlyteRemote, FlyteFile and FlyteDirectory are all very commonly used, but are not available as top-level imports.
This commit exposes them to the top-level of flytekit.
Additionally, it adds support for FlyteRemote classmethods.