forked from apache/beam
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Feature/bigtable error handling (apache#29885)
* first pass of wiring error handling into write files and adding tests * fix error handling to solve constant filenaming policy returning a null destination * fix tests, add a safety check to the error handler * spotless * add documentation * add textio error handler pass-through * add avroio error handler pass-through * add documentation to avroio * wire error handling into bigtable io * catch batching error when errors are detected * continue work on bigtable error handling * break apart and retry batches when they fail in bigquery * remove check for oversized mutation * spotless * fix merge error * address comments * add BigtableWriteIT test case. it unexpectedly passes * support routing more malformed mutation types, clean ups based on PR comments * make retrys non-async to remove race condition causing data loss * spotless * update comment on identifying data exception
- Loading branch information
1 parent
35b67c0
commit 70a7bb9
Showing
6 changed files
with
491 additions
and
44 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.