Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: Add Bigtable IO-connector for Go #23324

Closed
5 of 6 tasks
capthiron opened this issue Sep 21, 2022 · 1 comment · Fixed by #23411
Closed
5 of 6 tasks

[Feature Request]: Add Bigtable IO-connector for Go #23324

capthiron opened this issue Sep 21, 2022 · 1 comment · Fixed by #23411

Comments

@capthiron
Copy link
Contributor

capthiron commented Sep 21, 2022

What would you like to happen?

At work I came across the issue that there was no GCP Bigtable IO-connector for Go yet. So I started implementing one, orienting myself at the existing BigQuery connector.

For our first use-cases (BigQuery -> Bigtable data imports) we only needed the connector to write data, therefore we implemented a standard Write() and a WriteBatch() function. After our first successfully implemented use-case we are now building more pipelines to extensively test the durability, especially for large data imports. For other use-cases in the near future we will also need to look into implementing read capabilities.

TODOs before merging PR:

  • Implementation of single write function
  • Implementation of batch write function
  • Sufficient End-To-End Testing completed
  • Unit Tests written

Additional TODOs:

  • Implement read capabilities
  • Extend godocs with examples

Issue Priority

Priority: 2

Issue Component

Component: io-go-gcp

@capthiron
Copy link
Contributor Author

.take-issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment