[Bug] Fix concatenation issue with null values creating null rows in Snowflake

CHANGELOG.md

@@ -1,6 +1,28 @@
+# dbt_unified_rag v0.1.0-a6
+
+## Bug Fixes (requires `--full-refresh`)
+- Applied `coalesce_cast` macro to all relevant fields that are being concatenated into `comment_markdown`, as any concatenation in Snowflake with a null value returns null. We coalesced 'UNKNOWN' on a string field, and '1970-01-01 00:00:00' on a timestamp field to ensure Snowflake returns chunks of texts for all comments with null components.
+- Fields are now coalesced in these intermediate models:
+  - Hubspot
+    - `int_rag_hubspot__deal_comment_document`: `email_title` and `body` (string fields), `comment_time` (timestamp field).
+    - `int_rag_hubspot__deal_document`: `title` (string field) and `created_on` (timestamp field).
+  - Jira
+    - `int_rag_jira__issue_comment_document`: `comment_body` (string field) and `comment_time` (timestamp field).
+    - `int_rag_jira__issue_document`: `title` (string field) and `created_on` (timestamp field).
+  - Zendesk
+    - `int_rag_zendesk__ticket_comment_document`: `comment_body` (string field) and `comment_time` (timestamp field).
+    - `int_rag_zendesk__ticket_document`: `title` (string field) and `created_on` (timestamp field).
+- Corrected syntax errors for the `default_variable` in `stg_rag_hubspot__engagement_email` and `stg_rag_hubspot__engagement_note`.
+- Updated joins to ensure `engagement_deal` is the base in the `int_rag_hubspot__deal_comment_document` CTEs.
+- Added `most_recent_document` CTEs to `int_rag_*__deal_comment_documents_grouped` models in Hubspot, Jira and Zendesk to ensure we only bring in the `most_recent_chunk_update` by document.
+- Brought in `engagement_type` from the Hubspot `engagement_deal` source to produce proper chunk records in the `rag__unified_document`. Added filters on `email` and `note` types in `int_rag_hubspot__deal_comment_document` when creating email and note chunk records.
+
+## Under the Hood
+- Updated Hubspot seed files to ensure proper joins on end models.
+
 # dbt_unified_rag v0.1.0-a5
 
-## Breaking Changes (requires `--full-refresh)
+## Breaking Changes (requires `--full-refresh`)
 - Added `title` field to the `rag__unified_document` model and the individual HubSpot, Jira, and Zendesk unstructured `rag_<source>__document` models. ([#17](https://github.com/fivetran/dbt_unified_rag/pull/17))
 - This field draws from other pre-existing fields. Its addition therefore includes the following **breaking changes** in upstream staging and intermediate models:
   - Zendesk:

integration_tests/ci/sample.profiles.yml

@@ -16,13 +16,13 @@ integration_tests:
       pass: "{{ env_var('CI_REDSHIFT_DBT_PASS') }}"
       dbname: "{{ env_var('CI_REDSHIFT_DBT_DBNAME') }}"
       port: 5439
-      schema: rag_integration_tests_4
+      schema: rag_integration_tests_5
       threads: 8
     bigquery:
       type: bigquery
       method: service-account-json
       project: 'dbt-package-testing'
-      schema: rag_integration_tests_4
+      schema: rag_integration_tests_5
       threads: 8
       keyfile_json: "{{ env_var('GCLOUD_SERVICE_KEY') | as_native }}"
     snowflake:
@@ -33,7 +33,7 @@ integration_tests:
       role: "{{ env_var('CI_SNOWFLAKE_DBT_ROLE') }}"
       database: "{{ env_var('CI_SNOWFLAKE_DBT_DATABASE') }}"
       warehouse: "{{ env_var('CI_SNOWFLAKE_DBT_WAREHOUSE') }}"
-      schema: rag_integration_tests_4
+      schema: rag_integration_tests_5
       threads: 8
     postgres:
       type: postgres
@@ -42,13 +42,13 @@ integration_tests:
       pass: "{{ env_var('CI_POSTGRES_DBT_PASS') }}"
       dbname: "{{ env_var('CI_POSTGRES_DBT_DBNAME') }}"
       port: 5432
-      schema: rag_integration_tests_4
+      schema: rag_integration_tests_5
       threads: 8
     databricks:
       catalog: "{{ env_var('CI_DATABRICKS_DBT_CATALOG') }}"
       host: "{{ env_var('CI_DATABRICKS_DBT_HOST') }}"
       http_path: "{{ env_var('CI_DATABRICKS_DBT_HTTP_PATH') }}"
-      schema: rag_integration_tests_4
+      schema: rag_integration_tests_5
       threads: 2
       token: "{{ env_var('CI_DATABRICKS_DBT_TOKEN') }}"
       type: databricks

integration_tests/dbt_project.yml

@@ -11,9 +11,9 @@ models:
 vars:
   consistency_test_exclude_fields: ['title'] # for now
 
-  rag_hubspot_schema: "rag_integration_tests_4"
-  rag_zendesk_schema: "rag_integration_tests_4"
-  rag_jira_schema: "rag_integration_tests_4"
+  rag_hubspot_schema: "rag_integration_tests_04"
+  rag_zendesk_schema: "rag_integration_tests_04"
+  rag_jira_schema: "rag_integration_tests_04"
 
   rag_hubspot_engagement_identifier: "hubspot_engagement"
   rag_hubspot_engagement_note_identifier: "hubspot_engagement_note"
@@ -34,7 +34,7 @@ vars:
   rag_zendesk_ticket_comment_identifier: "zendesk_ticket_comment"
   rag_zendesk_user_identifier: "zendesk_user"
 
-  document_max_tokens: 50
+  document_max_tokens: 250
 
 seeds:
   rag_integration_tests:
@@ -121,6 +121,8 @@ seeds:
         _fivetran_synced: timestamp
         property_hs_createdate: timestamp
         property_hs_timestamp: timestamp
+        property_hs_email_to_email: "{{ 'string' if target.type in ('bigquery', 'spark', 'databricks', 'databricks-sql') else 'varchar' }}"
+        property_hs_email_from_email: "{{ 'string' if target.type in ('bigquery', 'spark', 'databricks', 'databricks-sql') else 'varchar' }}"
     hubspot_engagement_note:
       +column_types:
         engagement_id: "{{ 'int64' if target.type == 'bigquery' else 'bigint' }}"

integration_tests/packages.yml

@@ -1,2 +1,2 @@
 packages:
-  - local: ../
+  - local: ../

integration_tests/seeds/hubspot_contact.csv

@@ -1,12 +1,9 @@
-_fivetran_deleted,_fivetran_synced,property_email,id,property_company,property_firstname,property_lastname,property_email_1,property_createdate,property_jobtitle,property_annualrevenue,property_hs_calculated_merged_vids,property_created_at
-FALSE,2021-04-02 11:16:05.01511,fcb67ef339b691956cc85fa12be6490c,501,SampleCompany,db320f93ead463e1a2faee198cd9a122,22370ea245fce0b355938327d41bd1e4,261d3936e165a33b3f31e5fdd0e3121d,2021-04-01 17:32:47,,111111,76340251:1661707291575;46897301:1661707931852;76226001:1661696530403,2021-04-01 17:32:47.015110
-FALSE,2021-03-22 11:16:06.01510,6528bb7211b1dc066fc5c292561150c2,76340251,,b70e7b267b0652ee4030c4043cba7cf7,a0a1e71392fc13041b04f743c6727ca2,629f41f1733632c69114a624bca1e1d5,2021-03-21 14:33:30,,111111,,2021-03-21 14:33:30.015110
-FALSE,2021-04-02 11:20:23.01501,3abfda161ad50142007f6107db915761,46897301,,c13e13da2073260c2194c15d782e86a9,26c4e5c8064dc58f08b4ef2ebf463beb,4e52945af09feaa93bcfbf710fb23570,2020-10-08 21:13:55,,111111,,2020-10-08 21:13:55.015110
-FALSE,2021-03-22 11:16:08.13113,d8215e6e62b9398166ad67ca484fc58d,76226001,,48bc893fcbc0a33ed3ad2cf2d5d57cfe,7a03155bc7e8c00f13d70edae7974096,0474ac00326d6e93558e7727da5e3bdc,2021-03-20 21:42:56,,111111,,2021-03-20 21:42:56.015110
-FALSE,2021-04-02 11:19:58.31002,d63232cbab97fc1bb5808e4cba500347,36842001,,a703d6d14769d658f85a3b4c2c1ef9c7,5f55afd748fc4ad2580b768611325148,af58c55d6520c2470fd58e6893c06816,2020-07-15 04:46:01,,111111,,2020-07-15 04:46:01.015110
-FALSE,2021-04-02 11:17:59.32015,67717a9896fdbf93e2fa6655e75eb70f,55703851,,bf7c755353603f0bfca9f2070dbaa923,526664ec12dc5105f2c3171ca0909570,8370f130e1bb6435da412b168e29a0ab,2020-12-03 14:43:55,,111111,,2020-12-03 14:43:55.015110
-FALSE,2021-04-02 11:17:15.22132,90d65041363376d2abd1f0916df8fa42,74075201,,464e07afc9e46359fb480839150595c5,9c6e765da2eebc87f290f43f74d57c8d,24e5c02e37b9441c33978a53038200d4,2021-03-11 13:08:45,,111111,,2021-03-11 13:08:45.015110
-FALSE,2021-04-02 11:21:27.93209,226045995fbc87c01b2eb3847bc4ea8f,48722101,,464e07afc9e46359fb480839150595c5,7fe70fef470fcc46826966e201147015,5cf8d1f804144c2ef34dc98db0fd0105,2020-10-24 13:28:24,,111111,,2020-10-24 13:28:24.015110
-FALSE,2021-04-02 11:22:22.53525,b26ae870d0b4763efe3f4bbc53aab1d6,48067201,,8295bd3d7037a0e0c2ee11c99050a9c1,59830e37ce261d31ad0da0d5d270d0e1,abd71c63abd25c0f8286e76f319b9939,2020-10-19 02:34:46,,111111,,2020-10-19 02:34:46.015110
-FALSE,2021-04-02 11:20:39.43422,52a2d91b793f582dbe837ea464505732,69869451,,81b8a1b77068d06e1c8190825253066f,20c0c9b9bd7addf3a005da2e3ff184f4,674c0664494482302ec62fa4f11947bc,2021-02-19 13:23:50,,111111,,2021-02-19 13:23:50.015110
-FALSE,2021-04-02 11:20:49.23432,cba06e5c14a5aecfbb42d2e813ceb18e,32820151,,399423ff652ebb6a6701be7ec3202fc6,c22e1816539af64a7eadc2b81c3a1905,a37a075d75315d60478339a67c39340f,2020-05-22 16:46:41,,111111,,2020-05-22 16:46:41.015110
+_fivetran_deleted,_fivetran_synced,property_email,id,property_company,property_firstname,property_lastname,property_createdate,property_jobtitle,property_annualrevenue,property_hs_calculated_merged_vids,property_created_at
+FALSE,2021-04-02 11:16:05.01511,user325@example.com,501,SampleCompany,First122,Last984,2021-04-01 17:32:47,,111111,,2021-04-01 17:32:47.015110
+FALSE,2022-07-28 00:00:00.000000,user442@example.com,322,Company39,First209,Last990,2022-07-07 00:00:00.000000,,149610,,2022-05-15 00:00:00.000000
+FALSE,2022-01-25 00:00:00.000000,user156@example.com,455,Company19,First626,Last548,2023-04-08 00:00:00.000000,,204605,,2022-04-19 00:00:00.000000
+FALSE,2023-08-22 00:00:00.000000,user423@example.com,678,Company21,First250,Last553,2022-07-05 00:00:00.000000,,347558,,2023-10-17 00:00:00.000000
+FALSE,2023-06-11 00:00:00.000000,user109@example.com,898,Company70,First126,Last275,2022-05-06 00:00:00.000000,,294772,,2023-08-30 00:00:00.000000
+FALSE,2022-03-14 00:00:00.000000,user949@example.com,315,Company58,First768,Last326,2022-06-30 00:00:00.000000,,328641,,2022-04-29 00:00:00.000000
+FALSE,2023-10-05 00:00:00.000000,user877@example.com,788,Company88,First541,Last633,2022-11-14 00:00:00.000000,,177423,,2023-06-11 00:00:00.000000
+FALSE,2023-12-01 00:00:00.000000,user367@example.com,612,Company77,First438,Last862,2022-10-07 00:00:00.000000,,312655,,2023-11-19 00:00:00.000000

integration_tests/seeds/hubspot_deal.csv

@@ -1,13 +1,21 @@
 deal_id,is_deleted,deal_pipeline_id,deal_pipeline_stage_id,owner_id,portal_id,property_dealname,property_description,property_amount,property_closedate,property_createdate,property_deal_pt,property_is_good
-10828857779,false,,,,4727653,1f03614fdf8999728ac2cfeb1c4b3984,,,,2019-12-04 12:48:22.015110,1,true
-10828857780,false,,,,4727653,1d2a45a7d55ecc5fb7072ed75d8a3afc,,,,2019-10-07 20:36:05.015110,2,false
-10828857781,false,,,,4727653,5fefe701fdcd03dc5b16c50cf1c8e6ed,,,,2019-10-08 10:01:15.015110,3,true
-10828857782,false,,,,4727653,95cf7794ba54e56638529c05ba1364ae,,,,2019-10-08 13:54:32.015110,3,true
-10828857783,false,,,,4727653,6cec89eca1970181422965e7da1826b6,,,,2019-10-08 11:05:56.015110,4,true
-10828857784,false,,,,4727653,de6ab3cd99f288d36526d23787d54496,,,,2019-10-08 06:40:15.015110,5,
-10828857785,false,,,,4727653,7e99288de3ccf4e39a5f1a4605453282,,,,2019-10-08 09:08:29.015110,6,
-10828857786,false,,,,4727653,9cae9efcc3ed720b21e3e9eac0c20af3,,,,2019-10-08 17:30:50.015110,,
-10828857787,false,,,,4727653,3657db95a0167aa409df0adc760f3b07,,,,2019-10-08 06:38:07.015110,,
-10828857788,false,,,,4727653,c5d2784ea14c0d55a8ddec57bbc49353,,,,2019-11-16 15:48:14.015110,,
-10828857789,false,,,,4727653,034aa917268df3bbba8fe0a38ef4911b,,,,2019-10-08 12:05:26.015110,,
-10828857799,false,,,,4727653,e475834860834e4aa86f8b6aff90d305,,,,2019-10-08 11:44:36.015110,,
+10828857779,false,,,44023296,4727653,Deal A,,,,2019-12-04 12:48:22.015110,1,true
+10828857780,false,,,42972304,4727653,Deal B,,,,2019-10-07 20:36:05.015110,2,false
+10828857781,false,,,44642080,4727653,Deal C,,,,2019-10-08 10:01:15.015110,3,true
+10828857782,false,,,42087343,4727653,Deal D,,,,2019-10-08 13:54:32.015110,3,true
+10828857823,false,,,42703811,4727653,Deal 22,,,,2023-10-22 00:00:00.000000,5,true
+10828857814,false,,,40345879,4727653,Deal 64,,,,2023-01-17 00:00:00.000000,3,false
+10828857870,false,,,39540190,4727653,Deal 75,,,,2022-07-08 00:00:00.000000,3,true
+10828857834,false,,,42087329,4727653,Deal 54,,,,2022-06-17 00:00:00.000000,8,true
+10828857893,false,,,44024112,4727653,Deal 67,,,,2023-12-08 00:00:00.000000,10,false
+10828857845,false,,,44642080,4727653,Deal 99,,,,2023-09-02 00:00:00.000000,4,true
+10828857851,false,,,40345879,4727653,Deal 31,,,,2023-11-28 00:00:00.000000,7,false
+10828857872,false,,,42972304,4727653,Deal 47,,,,2022-03-14 00:00:00.000000,6,true
+10828857885,false,,,42087343,4727653,Deal 82,,,,2022-05-23 00:00:00.000000,9,false
+10828857896,false,,,42703811,4727653,Deal 55,,,,2023-04-09 00:00:00.000000,2,true
+10828857901,false,,,44023296,4727653,Deal 101,,,,2022-06-15 00:00:00.000000,5,false
+10828857902,false,,,42972304,4727653,Deal 102,,,,2023-02-01 00:00:00.000000,7,true
+10828857903,false,,,44642080,4727653,Deal 103,,,,2023-08-10 00:00:00.000000,4,false
+10828857904,false,,,42087343,4727653,Deal 104,,,,2023-07-20 00:00:00.000000,6,true
+10828857905,false,,,42703811,4727653,Deal 105,,,,2022-09-09 00:00:00.000000,8,false
+10828857906,false,,,40345879,4727653,Deal 106,,,,2023-11-18 00:00:00.000000,3,true

integration_tests/seeds/hubspot_engagement.csv

@@ -1,11 +1,15 @@
 id,_fivetran_synced,active,activity_type,created_at,last_updated,owner_id,portal_id,timestamp,type
-19732910159,2023-11-02 13:50:33.715000,,,,,,4703379,,CALL
-19732728857,2023-11-02 13:50:34.157000,,,,,,4703379,,NOTE
-32034885640,2023-11-02 13:50:34.159000,,,,,,4703379,,NOTE
-32034887079,2023-11-02 13:50:34.160000,,,,,,4703379,,NOTE
-32034932747,2023-11-02 13:50:34.161000,,,,,,4703379,,NOTE
-32034933592,2023-11-02 13:50:34.161000,,,,,,4703379,,NOTE
-32083319945,2023-11-02 13:50:34.162000,,,,,,4703379,,NOTE
-27683507047,2023-11-02 13:50:34.157000,,,,,,4703379,,NOTE
-27683507372,2023-11-02 13:50:34.158000,,,,,,4703379,,NOTE
-27683512957,2023-11-02 13:50:34.158000,,,,,,4703379,,NOTE
+19732728857,2023-11-02 13:50:34.157000,,,,,,4703379,2023-06-29 00:00:00.000000,NOTE
+31479928586,2023-11-02 13:50:34.159000,,,,,,4703379,2023-06-29 00:00:00.000000,EMAIL
+32034885640,2023-11-02 13:50:34.160000,,,,,,4703379,2023-06-29 00:00:00.000000,NOTE
+32034887079,2023-11-02 13:50:34.161000,,,,,,4703379,2023-06-29 00:00:00.000000,NOTE
+32034932747,2023-11-02 13:50:34.162000,,,,,,4703379,2023-06-29 00:00:00.000000,NOTE
+16751119893,2023-07-09 00:00:00.000000,,,,,44844650,4369627,2023-06-29 00:00:00.000000,CALL
+59200913849,2022-09-13 00:00:00.000000,,,,,49105932,4589797,2023-06-29 00:00:00.000000,NOTE
+89221515737,2022-05-20 00:00:00.000000,,,,,45348643,4133915,2023-06-29 00:00:00.000000,NOTE
+24178176780,2023-05-01 00:00:00.000000,,,,,41290728,4586843,2023-06-29 00:00:00.000000,NOTE
+33292787387,2023-01-04 00:00:00.000000,,,,,46497988,4549424,2023-06-29 00:00:00.000000,CALL
+48965432101,2023-06-15 00:00:00.000000,,,,,44642080,4727653,2023-06-29 00:00:00.000000,EMAIL
+59284711122,2023-02-10 00:00:00.000000,,,,,42087343,4727653,2023-06-29 00:00:00.000000,MEETING
+68475236985,2023-09-25 00:00:00.000000,,,,,42703811,4727653,2023-06-29 00:00:00.000000,NOTE
+78541235690,2023-03-19 00:00:00.000000,,,,,40345879,4727653,2023-06-29 00:00:00.000000,CALL

integration_tests/seeds/hubspot_engagement_contact.csv

@@ -1,3 +1,11 @@
 contact_id,engagement_id,engagement_type,type_id,_fivetran_synced,category
 501,19732910159,NOTE,195,2023-06-08 23:22:49.869000,HUBSPOT_DEFINED
-76340251,31479928586,EMAIL,194,2023-06-08 23:22:49.869000,HUBSPOT_DEFINED
+322,31479928586,EMAIL,196,2023-07-10 14:18:34.432000,HUBSPOT_DEFINED
+455,32034885640,NOTE,197,2023-08-12 09:54:21.123000,HUBSPOT_DEFINED
+678,32034887079,CALL,198,2023-09-05 18:30:42.567000,HUBSPOT_DEFINED
+899,32034932747,EMAIL,199,2023-10-22 07:14:55.982000,HUBSPOT_DEFINED
+315,12736610015,NOTE,200,2023-11-03 22:45:19.678000,HUBSPOT_DEFINED
+788,40207987550,EMAIL,201,2023-12-19 03:17:29.341000,HUBSPOT_DEFINED
+612,50634036083,CALL,202,2023-05-29 13:11:42.891000,HUBSPOT_DEFINED
+923,27189989892,NOTE,203,2023-04-15 10:25:31.751000,HUBSPOT_DEFINED
+841,62869905671,EMAIL,204,2023-06-07 16:40:55.264000,HUBSPOT_DEFINED

integration_tests/seeds/hubspot_engagement_deal.csv

@@ -1,3 +1,16 @@
 deal_id,engagement_id,engagement_type,type_id,_fivetran_synced,category
 10828857779,31479928586,EMAIL,216,2023-06-08 23:22:50.768000,HUBSPOT_DEFINED
-10828857779,19732728857,NOTE,216,2023-06-08 23:22:50.768000,HUBSPOT_DEFINED
+10828857779,19732728857,NOTE,216,2023-06-08 23:22:50.768000,HUBSPOT_DEFINED
+10828857780,49275136921,NOTE,216,2023-07-14 00:00:00.000000,HUBSPOT_DEFINED
+10828857781,68759237461,EMAIL,216,2023-09-18 00:00:00.000000,HUBSPOT_DEFINED
+10828857782,78521496852,NOTE,216,2023-06-10 00:00:00.000000,HUBSPOT_DEFINED
+10828857823,68475236985,EMAIL,216,2023-05-12 00:00:00.000000,HUBSPOT_DEFINED
+10828857814,78541235690,NOTE,216,2023-04-09 00:00:00.000000,HUBSPOT_DEFINED
+10828857870,87951236987,EMAIL,216,2023-06-21 00:00:00.000000,HUBSPOT_DEFINED
+10828857834,50234856978,NOTE,216,2023-07-02 00:00:00.000000,HUBSPOT_DEFINED
+10828857893,61478523694,EMAIL,216,2023-10-17 00:00:00.000000,HUBSPOT_DEFINED
+10828857845,71236548912,NOTE,216,2023-08-08 00:00:00.000000,HUBSPOT_DEFINED
+10828857851,81927546321,EMAIL,216,2023-09-25 00:00:00.000000,HUBSPOT_DEFINED
+10828857872,92857361452,NOTE,216,2023-11-30 00:00:00.000000,HUBSPOT_DEFINED
+10828857885,10345872659,EMAIL,216,2023-12-22 00:00:00.000000,HUBSPOT_DEFINED
+10828857896,11459283746,NOTE,216,2023-07-05 00:00:00.000000,HUBSPOT_DEFINED

integration_tests/seeds/hubspot_engagement_email.csv

@@ -1,2 +1,6 @@
 engagement_id,_fivetran_deleted,_fivetran_synced,property_hs_all_owner_ids,property_hs_all_team_ids,property_hs_createdate,property_hs_email_subject,property_hs_email_text,property_hs_lastmodifieddate,property_hs_modified_by,property_hs_timestamp,property_hubspot_owner_id,property_hubspot_team_id,type,property_hs_email_to_email,property_hs_email_from_email,property_hs_email_cc_email,property_hs_email_html,property_hs_body_preview,property_hs_body_preview_html
-31479928586,false,2023-06-08 23:23:03.974000,,,2022-03-01 19:23:23.390000,This is the subject of the email,This is the body of the email-Me,2022-03-01 19:23:23.390000,,2014-08-27 20:50:44.778000,,,EMAIL,to@you.com,from@me.com,add@other.com,<html>This is the body of the email-Me</html>,This is the body of the email-Me,<html>This is the body of the email-Me</html>
+31479928586,false,2023-06-08 23:23:03.974000,,,2022-03-01 19:23:23.390000,Subject A,Body of Email A,2022-03-01 19:23:23.390000,,2014-08-27 20:50:44.778000,,,EMAIL,to@you.com,from@me.com,add@other.com,<html>Body of Email A</html>,Body of Email A,<html>Body of Email A</html>
+12736610015,false,2022-08-27 00:00:00.000000,,,2023-11-08 00:00:00.000000,Subject B,Body of Email B,2022-08-31 00:00:00.000000,,2023-08-13 00:00:00.000000,,,EMAIL,user1@example.com,sender1@example.com,cc1@example.com,<html>Body of Email B</html>,Body preview 38,<html>Body preview 38</html>
+68475236985,false,2023-05-12 00:00:00.000000,,,2023-10-12 00:00:00.000000,Subject C,Body of Email C,2023-06-22 00:00:00.000000,,2023-07-15 00:00:00.000000,,,EMAIL,user2@example.com,sender2@example.com,cc2@example.com,<html>Body of Email C</html>,Body preview 89,<html>Body preview 89</html>
+78541235690,false,2023-04-09 00:00:00.000000,,,2023-11-20 00:00:00.000000,Subject D,Body of Email D,2023-09-11 00:00:00.000000,,2023-05-18 00:00:00.000000,,,EMAIL,user3@example.com,sender3@example.com,cc3@example.com,<html>Body of Email D</html>,Body preview 57,<html>Body preview 57</html>
+87951236987,false,2023-06-21 00:00:00.000000,,,2023-12-05 00:00:00.000000,Subject E,Body of Email E,2023-08-19 00:00:00.000000,,2023-07-27 00:00:00.000000,,,EMAIL,user4@example.com,sender4@example.com,cc4@example.com,<html>Body of Email E</html>,Body preview 44,<html>Body preview 44</html>