You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Current AWS Glue Catalog Hook does not have all the methods.
If possible, we can add get_partition and create_partition methods in existing Glue Catalog Hook.
Use case/motivation
I do work in Amazon.com. Our team is using Airflow to orchestrate Data Builds for our services.
In process of data builds, we need to create new Glue partitions for generated data and also retrieve particular Glue partition. Existing Glue Catalog Hook does not contain all the available methods.
Related issues
I was not able to find any related existing issues or feature request.
Hi @eladkal, I am new to the community and would like to work on this feature request. I looked at the codebase and get_partition method already exists. Should I put up a PR for create_partition and are there any other methods that should be added ?
Welcome to the community :) Unless I am mistaken get_partition does not exist, only get_partitions does. Sure! Feel free to create a PR for these 2 methods and I'll be more than happy to review it.
If you think other methods are needed, feel free to implement them too but implementing these 2 methods is already great :)
Description
Current AWS Glue Catalog Hook does not have all the methods.
If possible, we can add get_partition and create_partition methods in existing Glue Catalog Hook.
Use case/motivation
I do work in Amazon.com. Our team is using Airflow to orchestrate Data Builds for our services.
In process of data builds, we need to create new Glue partitions for generated data and also retrieve particular Glue partition. Existing Glue Catalog Hook does not contain all the available methods.
Related issues
I was not able to find any related existing issues or feature request.
Are you willing to submit a PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: