Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Rather than simply pass along all source columns sans
property_
, why not set a default set of core columns and allow the user to add custom data columns using variable maps. Some tables have 100+ fields, with many that have very little value.hubspot.deal
is particularly awful; for example, what can I do withproperty_hs_date_exited_1215013
...This behavior also ensures that all renaming and casting is captured in the staging and allows for simpler, downstream models
I've mocked up what this could look like for HubSpot deals but this could also be used for the
company
,contact
, and soon-to-cometicket
models.Sample var for deal columns: