v0.10.0

What's Changed

New Features:

• [IBCDPE-923] snowflake integration by @thomasyu888 in #112
• [ETL-648] Modify comparsion job to only consider records from recent exports by @rxu17 in #119

Full Changelog: v0.9.0...v0.10.0

v0.9.0

What's Changed

New Features:

• [ETL-634] Implement Dispatch Lambda by @philerooski in #114. This is not a feature by itself, but is related to our work around building data quality infrastructure.

Bug Fix:

• [ETL-647] Only submit most recent ~2 weeks of exports for integration tests by @philerooski in #115
• [ETL-653] Add corresponding deleted data type table for all HealthKit data types by @philerooski in #116
• [ETL-655] Add Device field to fitbitdevices INDEX_FIELD_MAP by @philerooski in #117
• [ETL-656] Limit input-to-intermediate Lambda batch size to 1 by @philerooski in #118

Full Changelog: v0.8.0...v0.9.0

v0.8.0

What's Changed

• [ETL-644] Update drop_table_duplicates function to use new method by @philerooski in #113

Full Changelog: v0.7.1...v0.8.0

v0.7.1

What's Changed

• [ETL-631] Update index fields with ParticipantIdentifier and propagate participant id fields by @philerooski in #110

Full Changelog: v0.7.0...v0.7.1

v0.7.0

What's Changed

• [ETL-608] Create raw S3 bucket by @philerooski in #103
• [ETL-610] Add SQS queue for input to raw buckets processing by @philerooski in #104
• [ETL-602] Compile documentation for recover by @rxu17 in #105
• [ETL-621] Add SNS topic to broadcast new exports by @philerooski in #106
• [ETL-626] Delete preexisting S3 event notification before creation by @philerooski in #107
• [ETL-628] Rework S3 event config lambda by @philerooski in #108
• Upgrade JSON to Parquet large job worker type by @philerooski in #109

Full Changelog: v0.6.0...v0.7.0

v0.6.0

What's Changed

• [ETL-593] Record sort ordering for duplicate records by @BryanFauble in #101
• [ETL-590] Fitbit ecg by @BryanFauble in #102

Full Changelog: v0.5.2...v0.6.0

v0.5.2

What's Changed

• [ETL-591] Add EOPDate field and fix location of other EOP fields by @philerooski in #100

Full Changelog: v0.5.1...v0.5.2

v0.5.1

What's Changed

• [ETL-587] Add fields EOPReason, EOPRemoveData, and IsMainSleep by @philerooski in #97

Full Changelog: v0.5.0...v0.5.1

v0.5.0

What's Changed

• [ETL-580] JSON to Parquet - Write record count of each export to S3 by @philerooski in #93
• [ETL-589] Fix parameter type in delete_objects call by @philerooski in #98
• [ETL-589] Fix parameter type in delete_objects call by @philerooski in #99

Full Changelog: v0.4.8...v0.5.0

v0.4.8

What's Changed

• [ETL-585] Upgrade worker type for HealthKitV2Samples and FitbitIntraday to G.2X by @philerooski in #96

Full Changelog: v0.4.7...v0.4.8