Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BigTable connector #12591

Closed
joshliberty opened this issue Jul 25, 2023 · 1 comment · Fixed by #15122
Closed

BigTable connector #12591

joshliberty opened this issue Jul 25, 2023 · 1 comment · Fixed by #15122
Assignees
@sushi30
Labels
connectors enhancement New feature or request Ingestion

Comments

@joshliberty
Copy link
Contributor

Describe the solution you'd like
A database connector for BigTable

Describe alternatives you've considered
N/A - no connector exists
@joshliberty joshliberty added the enhancement New feature or request label Jul 25, 2023
@ulixius9 ulixius9 added this to Backlog Jul 28, 2023
@sushi30
Copy link
Contributor

sushi30 commented Feb 6, 2024

Hi @joshliberty. Thank you for opening the issue. I am looking into the best way to reflect the BigTable assets in OpenMetadata's data model. Can you provide a sample data set that demonstrates how you use BigTable?

@TeddyCr TeddyCr removed this from Backlog Feb 8, 2024
@sushi30 sushi30 mentioned this issue Feb 12, 2024
Merged
5 tasks
pmbrull pushed a commit that referenced this issue Feb 13, 2024
@sushi30
fixes #12591: add BigTable (#15122)
aeb5fbe 
* feat(connector): add BigTable

* bigtable work

1. docstrings
2. tests
3. created a Row BaseModel
4. implemented a ClassConverter

* docs moved to separate PR

* format files

* minor cosmetic

- removed TODO
- changed headers' year to 2024 for new files
- fixed typos

* format

* formatting and comments

1. added missing docstrings.
2. abstracted the _find_instance method.
3. aliased the IDs used in the BigTable connection

* added comment regarding private key

* added comments regarding column families

* enclose get_schema_name_list in `try/except/else`

* format

* streamlined get_schema_name_list to include all logic in the try block
@pmbrull pmbrull moved this to Done in Release 1.3.2 Feb 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sushi30 sushi30

Labels
connectors enhancement New feature or request Ingestion
Projects
No open projects
Release 1.3.2
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fixes #12591: add BigTable open-metadata/OpenMetadata
4 participants
@joshliberty @sushi30 @pmbrull @ulixius9