You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In working on the SDK testing framework, it has become apparent that Meltanos' catalog manipulations (i.e. selection, metadata injection and schema overrides) would be very useful within the SDK config dictionary itself, so that tests can take advantage of these shorthands.
Use cases:
Selecting specific streams to test with (e.g. from a database containing many schema and tables).
Test streams in FULL_TABLE and INCREMENTAL modes, by setting metadata.
Override the schema to test behaviours when columns are added/removed or types change.
These things are possible by manually curating many catalog.json files, but this is labour intensive and repetitive work for Tap/Target developers.
The text was updated successfully, but these errors were encountered:
This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen label, or request that it be added.
This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen label, or request that it be added.
Feature scope
Configuration (settings parsing, validation, etc.)
Description
In working on the SDK testing framework, it has become apparent that Meltanos' catalog manipulations (i.e. selection, metadata injection and schema overrides) would be very useful within the SDK
config
dictionary itself, so that tests can take advantage of these shorthands.Use cases:
FULL_TABLE
andINCREMENTAL
modes, by setting metadata.These things are possible by manually curating many
catalog.json
files, but this is labour intensive and repetitive work for Tap/Target developers.The text was updated successfully, but these errors were encountered: