Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Taxonomy of optional capabilities for taps and targets #5

Open
aaronsteers opened this issue Aug 11, 2021 · 0 comments
Open

Taxonomy of optional capabilities for taps and targets #5

aaronsteers opened this issue Aug 11, 2021 · 0 comments

Comments

@aaronsteers
Copy link
Contributor

aaronsteers commented Aug 11, 2021

(Partially enumerated in: https://gitlab.com/meltano/meltano/-/issues/2829 and in related SDK MR: https://gitlab.com/meltano/sdk/-/merge_requests/141/diffs#1a46f5bc80ac2afe420e39f5eb5c82cb4d690483_0_112)


For taps only:

  • discover - the ability to print a catalog.json file with all known streams and their schemas (as described in existing Singer Spec)
  • catalog (newer) and properties (previous iteration) - the ability to pass in a catalog.json file with selection logic (as described in existing Singer Spec)
  • log-based the ability for database-type sources to read from logs (as described in existing Singer Spec)

For targets only:

  • soft-delete - The ability to flag records as deleted, based on a deleted_at property or some other signal.
  • hard-delete - The ability to permanently delete records, based on a deleted_at property or some other signal.
  • datatype-failsafe - The promise that records will be written to the target when the data type is not in an expected/handled set of cases and/or when the target cannot parse the JSON Schema type (as proposed in Best Practice Target Capability: Data Type Failsafe #20).

For both taps and targets:


Related to: #4

@aaronsteers aaronsteers changed the title Taxonomy of tap and target features/capabilities Taxonomy of features and capabilities for taps and targets Oct 25, 2021
@aaronsteers aaronsteers changed the title Taxonomy of features and capabilities for taps and targets Taxonomy of optional capabilities for taps and targets Oct 25, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant