Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bringing over changes to new branch #30

Merged
merged 30 commits into from
Jul 12, 2022
Merged
Show file tree
Hide file tree
Changes from 19 commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
2945817
bringing over changes to new branch
fivetran-reneeli Jun 14, 2022
2e20689
src yml
fivetran-reneeli Jun 14, 2022
d10c93c
src yml
fivetran-reneeli Jun 15, 2022
a8594ea
stg yml
fivetran-reneeli Jun 15, 2022
d81bb9c
clean up staging models
fivetran-reneeli Jun 15, 2022
f57abe1
remove unrecognized booleans
fivetran-reneeli Jun 15, 2022
2259a0f
remove is_deleted
fivetran-reneeli Jun 15, 2022
d150e47
clean seed dataa
fivetran-reneeli Jun 15, 2022
31b3d84
integration test cast timestamp
fivetran-reneeli Jun 15, 2022
7bd60da
try1
fivetran-reneeli Jun 15, 2022
d5f5ba5
specify data type boolean
fivetran-reneeli Jun 15, 2022
88fc7ff
docuemntation
fivetran-reneeli Jun 15, 2022
4823802
docs
fivetran-reneeli Jun 15, 2022
616bbd4
update docs
fivetran-reneeli Jun 15, 2022
15c7c6a
version
fivetran-reneeli Jun 15, 2022
cb6fcd8
clean up
fivetran-reneeli Jun 15, 2022
84b487d
docs
fivetran-reneeli Jun 15, 2022
6185cce
update stg yml
fivetran-reneeli Jun 15, 2022
27f0d7e
tab whitespace removal
fivetran-joemarkiewicz Jun 15, 2022
da9ff93
Update README.md
fivetran-reneeli Jun 15, 2022
ab0a69a
remove unneeded cols from macro
fivetran-reneeli Jun 15, 2022
0a409da
cleanup
fivetran-reneeli Jun 15, 2022
c378484
versioning
fivetran-reneeli Jun 15, 2022
804eb18
update readme
fivetran-reneeli Jun 22, 2022
06c3e7e
update columns
fivetran-reneeli Jun 23, 2022
dfb5d52
versioning
fivetran-reneeli Jun 29, 2022
d020ff0
update readme
fivetran-reneeli Jun 29, 2022
d274153
update field desc
fivetran-reneeli Jun 29, 2022
35aff4f
add enable/disable configs
fivetran-reneeli Jun 30, 2022
d8dd8a8
update readme
fivetran-reneeli Jul 12, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
74 changes: 38 additions & 36 deletions .circleci/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -25,42 +25,6 @@ jobs:
pip install -r integration_tests/requirements.txt
mkdir -p ~/.dbt
cp integration_tests/ci/sample.profiles.yml ~/.dbt/profiles.yml
- run:
name: "Run Tests - Spark"
command: |
. venv/bin/activate
echo `pwd`
cd integration_tests
dbt deps
dbt seed --target spark --full-refresh
dbt run --vars '{using_account_history_mode_active_records: true, using_opportunity_history_mode_active_records: true, using_user_role_history_mode_active_records: true, using_user_history_mode_active_records: true, salesforce__user_role_enabled: false}' --target spark --full-refresh
dbt test --vars '{salesforce__user_role_enabled: false}' --target spark
dbt run --target spark --full-refresh
dbt test --target spark
- run:
name: "Run Tests - Postgres"
command: |
. venv/bin/activate
echo `pwd`
cd integration_tests
dbt deps
dbt seed --target postgres --full-refresh
dbt run --vars '{using_account_history_mode_active_records: true, using_opportunity_history_mode_active_records: true, using_user_role_history_mode_active_records: true, using_user_history_mode_active_records: true, salesforce__user_role_enabled: false}' --target postgres --full-refresh
dbt test --vars '{salesforce__user_role_enabled: false}' --target postgres
dbt run --target postgres --full-refresh
dbt test --target postgres
- run:
name: "Run Tests - Redshift"
command: |
. venv/bin/activate
echo `pwd`
cd integration_tests
dbt deps
dbt seed --target redshift --full-refresh
dbt run --vars '{using_account_history_mode_active_records: true, using_opportunity_history_mode_active_records: true, using_user_role_history_mode_active_records: true, using_user_history_mode_active_records: true, salesforce__user_role_enabled: false}' --target redshift --full-refresh
dbt test --vars '{salesforce__user_role_enabled: false}' --target redshift
dbt run --target redshift --full-refresh
dbt test --target redshift
- run:
name: "Run Tests - Snowflake"
command: |
Expand Down Expand Up @@ -92,3 +56,41 @@ jobs:
key: deps2-{{ .Branch }}
paths:
- "venv"

- run:
name: "Run Tests - Postgres"
command: |
. venv/bin/activate
echo `pwd`
cd integration_tests
dbt deps
dbt seed --target postgres --full-refresh
dbt run --vars '{using_account_history_mode_active_records: true, using_opportunity_history_mode_active_records: true, using_user_role_history_mode_active_records: true, using_user_history_mode_active_records: true, salesforce__user_role_enabled: false}' --target postgres --full-refresh
dbt test --vars '{salesforce__user_role_enabled: false}' --target postgres
dbt run --target postgres --full-refresh
dbt test --target postgres

- run:
name: "Run Tests - Spark"
command: |
. venv/bin/activate
echo `pwd`
cd integration_tests
dbt deps
dbt seed --target spark --full-refresh
dbt run --vars '{using_account_history_mode_active_records: true, using_opportunity_history_mode_active_records: true, using_user_role_history_mode_active_records: true, using_user_history_mode_active_records: true, salesforce__user_role_enabled: false}' --target spark --full-refresh
dbt test --vars '{salesforce__user_role_enabled: false}' --target spark
dbt run --target spark --full-refresh
dbt test --target spark
- run:
name: "Run Tests - Redshift"
command: |
. venv/bin/activate
echo `pwd`
cd integration_tests
dbt deps
dbt seed --target redshift --full-refresh
dbt run --vars '{using_account_history_mode_active_records: true, using_opportunity_history_mode_active_records: true, using_user_role_history_mode_active_records: true, using_user_history_mode_active_records: true, salesforce__user_role_enabled: false}' --target redshift --full-refresh
dbt test --vars '{salesforce__user_role_enabled: false}' --target redshift
dbt run --target redshift --full-refresh
dbt test --target redshift
5 changes: 4 additions & 1 deletion .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,7 @@
contact_links:
- name: Provide feedback or request a new package to our dbt package team
url: https://www.surveymonkey.com/r/DQ7K7WW
about: Fill out our survey form to provide valuable feedback to the Fivetran team developing and maintaining the dbt packages.
- name: Ask a question during our office hours
url: https://calendly.com/fivetran-solutions-team/fivetran-solutions-team-office-hours
about: Schedule time during the external office hours block with the Fivetran Analytics Engineering team for support
Expand All @@ -10,4 +13,4 @@ contact_links:
about: Check out the dbt docs for all dbt related information
- name: Hang out in dbt Slack
url: https://www.getdbt.com/community/
about: Have a question or just want to chat with fellow data friends, join dbt Slack and hangout in the tools-fivetran channel with us!
about: Have a question or just want to chat with fellow data friends, join dbt Slack and hangout in the tools-fivetran channel with us!
1 change: 0 additions & 1 deletion .github/pull_request_template.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@
Pull Request
**Are you a current Fivetran customer?**
<!--- Please tell us your name, title and company -->

Expand Down
12 changes: 12 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,15 @@
# dbt_salesforce_source v0.5.0
🎉 Salesforce Package Updates 🎉

We are updating the Salesforce package! To improve its utility, the changes include the following:
## Features
- Bringing additional tables to create a new Contact Enhanced and Sales Velocity model as well as updating the Opportunity Enhanced model. ([#30](https://github.com/fivetran/dbt_salesforce_source/pull/30))
- Allowing formula fields to be added as passthrough columns. We added integration with the Salesforce Formula package by embedding the macro outputs as part of our staging models so that your custom formula fields can be included. ([#30](https://github.com/fivetran/dbt_salesforce_source/pull/30))
- Standardization updates ([#25](https://github.com/fivetran/dbt_salesforce_source/pull/25)):
- Updated formatting in our `sql` files.
- The README has been updated to reflect our rehaul of our documentation style to make it more straightforward.
- Added `identifier` variable to each source to allow for more end-user customization on which table to pull from.

# dbt_salesforce_source v0.4.2
## Fixes
- Casts the `created_date` and `closed_date` fields within the `stg_salesforce__opportunity` model to a timestamp using the `dbt_utils.type_timestamp()` macro. This is needed for Redshift users that see these fields being synced as `timestamptz` as the downstream date functions do not work with the timestamptz datatype.
Expand Down
Loading