2022-05-18 19:58:35 INFO i.a.w.w.WorkerRun(call):49 - Executing worker wrapper. Airbyte version: 0.38.4-alpha 2022-05-18 19:58:35 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Cloud storage job log path: /workspace/403/0/logs.log 2022-05-18 19:58:38 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-05-18 19:59:29 WARN i.a.s.p.JobNotifier(notifyJob):116 - Failed to successfully notify success: io.airbyte.config.Notification@28c78617[notificationType=slack,sendOnSuccess=false,sendOnFailure=true,slackConfiguration=io.airbyte.config.SlackNotificationConfiguration@5ec9a106[webhook=https://hooks.slack.com/services/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],customerioConfiguration=,additionalProperties={}] 2022-05-18 19:59:29 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.access_token: object found, string expected, $.credentials: does not have a value in the enumeration [oauth2.0], $.credentials: must be a constant value oauth2.0 2022-05-18 19:59:29 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.access_token: object found, string expected 2022-05-18 19:59:29 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.credential: is not defined in the schema and the schema does not allow additional properties, $.part_size_mb: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_name: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_path: is not defined in the schema and the schema does not allow additional properties, $.keep_files_in_gcs-bucket: is not defined in the schema and the schema does not allow additional properties, $.method: must be a constant value Standard 2022-05-18 19:59:29 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.credential.hmac_key_access_id: object found, string expected, $.credential.hmac_key_secret: object found, string expected 2022-05-18 19:58:35 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.38.4-alpha 2022-05-18 19:58:35 INFO i.a.w.DefaultReplicationWorker(run):109 - start sync worker. job id: 403 attempt id: 0 2022-05-18 19:58:35 INFO i.a.w.DefaultReplicationWorker(run):121 - configured sync modes: {null.accounts=full_refresh - overwrite} 2022-05-18 19:58:35 INFO i.a.w.p.a.DefaultAirbyteDestination(start):69 - Running destination... 2022-05-18 19:58:35 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = destination-bigquery-write-403-0-xdsjs for airbyte/destination-bigquery:1.0.1 2022-05-18 19:58:35 INFO i.a.w.p.KubeProcessFactory(create):103 - destination-bigquery-write-403-0-xdsjs stdoutLocalPort = 9016 2022-05-18 19:58:35 INFO i.a.w.p.KubeProcessFactory(create):106 - destination-bigquery-write-403-0-xdsjs stderrLocalPort = 9017 2022-05-18 19:58:35 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):583 - Creating stdout socket server... 2022-05-18 19:58:35 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):601 - Creating stderr socket server... 2022-05-18 19:58:35 INFO i.a.w.p.KubePodProcess():515 - Creating pod destination-bigquery-write-403-0-xdsjs... 2022-05-18 19:58:35 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):305 - Waiting for init container to be ready before copying files... 2022-05-18 19:58:35 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Init container present.. 2022-05-18 19:58:36 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):312 - Init container ready.. 2022-05-18 19:58:36 INFO i.a.w.p.KubePodProcess():546 - Copying files... 2022-05-18 19:58:36 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: destination_config.json 2022-05-18 19:58:36 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/ba9e2b6e-18f2-4fe4-b982-9ca35f5347dd/destination_config.json prod/destination-bigquery-write-403-0-xdsjs:/config/destination_config.json -c init 2022-05-18 19:58:36 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-05-18 19:58:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-05-18 19:58:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: destination_catalog.json 2022-05-18 19:58:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/71cdddc4-b9ce-43ef-9e7f-1e3bc4237a1f/destination_catalog.json prod/destination-bigquery-write-403-0-xdsjs:/config/destination_catalog.json -c init 2022-05-18 19:58:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-05-18 19:58:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-05-18 19:58:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: FINISHED_UPLOADING 2022-05-18 19:58:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/ed3d346c-6955-47b8-b8ef-abd3b3955732/FINISHED_UPLOADING prod/destination-bigquery-write-403-0-xdsjs:/config/FINISHED_UPLOADING -c init 2022-05-18 19:58:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-05-18 19:58:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-05-18 19:58:37 INFO i.a.w.p.KubePodProcess():549 - Waiting until pod is ready... 2022-05-18 19:58:38 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):592 - Setting stdout... 2022-05-18 19:58:38 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):604 - Setting stderr... 2022-05-18 19:58:38 INFO i.a.w.p.KubePodProcess():564 - Reading pod IP... 2022-05-18 19:58:38 INFO i.a.w.p.KubePodProcess():566 - Pod IP: 172.19.3.67 2022-05-18 19:58:38 INFO i.a.w.p.KubePodProcess():569 - Creating stdin socket... 2022-05-18 19:58:38 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = source-zendesk-chat-read-403-0-hyxhm for us-east1-docker.pkg.dev/bi-data-science/airbyte/source-zendesk-chat:0.0.2 2022-05-18 19:58:38 INFO i.a.w.p.KubeProcessFactory(create):103 - source-zendesk-chat-read-403-0-hyxhm stdoutLocalPort = 9018 2022-05-18 19:58:38 INFO i.a.w.p.KubeProcessFactory(create):106 - source-zendesk-chat-read-403-0-hyxhm stderrLocalPort = 9019 2022-05-18 19:58:38 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):601 - Creating stderr socket server... 2022-05-18 19:58:38 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):583 - Creating stdout socket server... 2022-05-18 19:58:38 INFO i.a.w.p.KubePodProcess():515 - Creating pod source-zendesk-chat-read-403-0-hyxhm... 2022-05-18 19:58:39 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):305 - Waiting for init container to be ready before copying files... 2022-05-18 19:58:39 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Init container present.. 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):312 - Init container ready.. 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess():546 - Copying files... 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: source_config.json 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/e55ec66e-6e39-424f-a99b-7e1f10e6b5b5/source_config.json prod/source-zendesk-chat-read-403-0-hyxhm:/config/source_config.json -c init 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: source_catalog.json 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/6481cb64-6ede-429d-9dcf-5e0c18b06379/source_catalog.json prod/source-zendesk-chat-read-403-0-hyxhm:/config/source_catalog.json -c init 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: FINISHED_UPLOADING 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/6d8a769b-ef9c-452c-bd3e-a2b4a5cc23d5/FINISHED_UPLOADING prod/source-zendesk-chat-read-403-0-hyxhm:/config/FINISHED_UPLOADING -c init 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-05-18 19:58:40 INFO i.a.w.p.KubePodProcess():549 - Waiting until pod is ready... 2022-05-18 19:58:44 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):604 - Setting stderr... 2022-05-18 19:58:44 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):592 - Setting stdout... 2022-05-18 19:58:45 INFO i.a.w.p.KubePodProcess():564 - Reading pod IP... 2022-05-18 19:58:45 INFO i.a.w.p.KubePodProcess():566 - Pod IP: 172.19.6.244 2022-05-18 19:58:45 INFO i.a.w.p.KubePodProcess():573 - Using null stdin output stream... 2022-05-18 19:58:45 INFO i.a.w.DefaultReplicationWorker(run):163 - Waiting for source and destination threads to complete. 2022-05-18 19:58:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$6):292 - Replication thread started. 2022-05-18 19:58:45 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):382 - Destination output thread started. 2022-05-18 19:58:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$6):334 - Source has no more messages, closing connection. 2022-05-18 19:58:47 INFO i.a.w.p.KubePodProcess(close):713 - (pod: prod / source-zendesk-chat-read-403-0-hyxhm) - Closed all resources for pod 2022-05-18 19:58:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$6):342 - Total records read: 1 (792 bytes) 2022-05-18 19:58:47 INFO i.a.w.DefaultReplicationWorker(run):168 - One of source or destination thread complete. Waiting on the other. 2022-05-18 19:58:55 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $: null found, object expected 2022-05-18 19:58:55 ERROR i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-05-18 19:58:56 INFO i.a.w.p.KubePodProcess(close):713 - (pod: prod / destination-bigquery-write-403-0-xdsjs) - Closed all resources for pod 2022-05-18 19:58:56 INFO i.a.w.DefaultReplicationWorker(run):170 - Source and destination threads complete. 2022-05-18 19:58:56 INFO i.a.w.DefaultReplicationWorker(run):233 - sync summary: io.airbyte.config.ReplicationAttemptSummary@7915518a[status=completed,recordsSynced=1,bytesSynced=792,startTime=1652903915203,endTime=1652903936039,totalStats=io.airbyte.config.SyncStats@d498c6e[recordsEmitted=1,bytesEmitted=792,stateMessagesEmitted=0,recordsCommitted=1],streamStats=[io.airbyte.config.StreamSyncStats@cb8329d[streamName=accounts,stats=io.airbyte.config.SyncStats@61aa50c6[recordsEmitted=1,bytesEmitted=792,stateMessagesEmitted=,recordsCommitted=1]]]] 2022-05-18 19:58:56 INFO i.a.w.DefaultReplicationWorker(run):262 - Source did not output any state messages 2022-05-18 19:58:56 WARN i.a.w.DefaultReplicationWorker(run):273 - State capture: No state retained. 2022-05-18 19:58:56 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-05-18 19:58:56 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@3bc3e17e[standardSyncSummary=io.airbyte.config.StandardSyncSummary@fa1b46f[status=completed,recordsSynced=1,bytesSynced=792,startTime=1652903915203,endTime=1652903936039,totalStats=io.airbyte.config.SyncStats@d498c6e[recordsEmitted=1,bytesEmitted=792,stateMessagesEmitted=0,recordsCommitted=1],streamStats=[io.airbyte.config.StreamSyncStats@cb8329d[streamName=accounts,stats=io.airbyte.config.SyncStats@61aa50c6[recordsEmitted=1,bytesEmitted=792,stateMessagesEmitted=,recordsCommitted=1]]]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@67a5fbde[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@63bc96f7[stream=io.airbyte.protocol.models.AirbyteStream@47d043ef[name=accounts,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"plan":{"type":["null","object"],"properties":{"sla":{"type":["null","boolean"]},"name":{"type":["null","string"]},"goals":{"type":["null","integer"]},"price":{"type":["null","number"],"maximum":1000000000000000000000000000000000,"minimum":-1000000000000000000000000000000000},"support":{"type":["null","boolean"]},"rest_api":{"type":["null","boolean"]},"analytics":{"type":["null","boolean"]},"high_load":{"type":["null","boolean"]},"long_desc":{"type":["null","string"]},"max_agents":{"type":["null","integer"]},"monitoring":{"type":["null","boolean"]},"short_desc":{"type":["null","string"]},"unbranding":{"type":["null","boolean"]},"file_upload":{"type":["null","boolean"]},"chat_reports":{"type":["null","boolean"]},"integrations":{"type":["null","boolean"]},"agent_reports":{"type":["null","boolean"]},"daily_reports":{"type":["null","boolean"]},"email_reports":{"type":["null","boolean"]},"ip_restriction":{"type":["null","boolean"]},"max_departments":{"type":["null","string"]},"operating_hours":{"type":["null","boolean"]},"agent_leaderboard":{"type":["null","boolean"]},"max_basic_triggers":{"type":["null","string"]},"max_concurrent_chats":{"type":["null","string"]},"widget_customization":{"type":["null","string"]},"max_advanced_triggers":{"type":["null","string"]},"max_history_search_days":{"type":["null","string"]}}},"status":{"type":["null","string"]},"billing":{"type":["null","object"],"properties":{"city":{"type":["null","string"]},"cycle":{"type":["null","integer"]},"email":{"type":["null","string"]},"phone":{"type":["null","string"]},"state":{"type":["null","string"]},"company":{"type":["null","string"]},"address1":{"type":["null","string"]},"address2":{"type":["null","string"]},"last_name":{"type":["null","string"]},"first_name":{"type":["null","string"]},"postal_code":{"type":["null","string"]},"country_code":{"type":["null","string"]},"additional_info":{"type":["null","string"]}}},"account_key":{"type":["null","string"]},"create_date":{"type":["null","string"],"format":"date-time"}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[account_key]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[account_key]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-05-18 19:58:56 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):236 - Stopping temporal heartbeating... 2022-05-18 19:58:56 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Cloud storage job log path: /workspace/403/0/logs.log 2022-05-18 19:58:56 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.38.4-alpha 2022-05-18 19:58:56 INFO i.a.w.DefaultNormalizationWorker(run):47 - Running normalization. 2022-05-18 19:58:56 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.0 2022-05-18 19:58:56 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = normalization-normalize-403-0-majyu for airbyte/normalization:0.2.0 2022-05-18 19:58:56 INFO i.a.w.p.KubeProcessFactory(create):103 - normalization-normalize-403-0-majyu stdoutLocalPort = 9020 2022-05-18 19:58:56 INFO i.a.w.p.KubeProcessFactory(create):106 - normalization-normalize-403-0-majyu stderrLocalPort = 9021 2022-05-18 19:58:56 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):601 - Creating stderr socket server... 2022-05-18 19:58:56 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):583 - Creating stdout socket server... 2022-05-18 19:58:56 INFO i.a.w.p.KubePodProcess():515 - Creating pod normalization-normalize-403-0-majyu... 2022-05-18 19:58:56 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):305 - Waiting for init container to be ready before copying files... 2022-05-18 19:58:56 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Init container present.. 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):312 - Init container ready.. 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess():546 - Copying files... 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: destination_config.json 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/748fa922-2267-44de-bb49-b3f02dbac750/destination_config.json prod/normalization-normalize-403-0-majyu:/config/destination_config.json -c init 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: destination_catalog.json 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/990c7abd-7e0c-48e6-8661-20ff3d7ea0a2/destination_catalog.json prod/normalization-normalize-403-0-majyu:/config/destination_catalog.json -c init 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: FINISHED_UPLOADING 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/ae70e882-1b1a-4e89-944e-6bf551836b4a/FINISHED_UPLOADING prod/normalization-normalize-403-0-majyu:/config/FINISHED_UPLOADING -c init 2022-05-18 19:58:58 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-05-18 19:58:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-05-18 19:58:59 INFO i.a.w.p.KubePodProcess():549 - Waiting until pod is ready... 2022-05-18 19:59:01 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):592 - Setting stdout... 2022-05-18 19:59:01 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):604 - Setting stderr... 2022-05-18 19:59:02 INFO i.a.w.p.KubePodProcess():564 - Reading pod IP... 2022-05-18 19:59:02 INFO i.a.w.p.KubePodProcess():566 - Pod IP: 172.19.6.245 2022-05-18 19:59:02 INFO i.a.w.p.KubePodProcess():573 - Using null stdin output stream... 2022-05-18 19:59:29 INFO i.a.w.p.KubePodProcess(close):713 - (pod: prod / normalization-normalize-403-0-majyu) - Closed all resources for pod 2022-05-18 19:59:29 INFO i.a.w.DefaultNormalizationWorker(run):71 - Normalization executed in 33 seconds. 2022-05-18 19:59:29 INFO i.a.w.DefaultNormalizationWorker(run):77 - Normalization summary: io.airbyte.config.NormalizationSummary@7e921701[startTime=1652903936185,endTime=1652903969286] 2022-05-18 19:59:29 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-05-18 19:59:29 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):236 - Stopping temporal heartbeating... 2022-05-18 19:58:38 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-05-18 19:58:38 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-05-18 19:58:38 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-05-18 19:58:38 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-05-18 19:58:45 source > Starting syncing SourceZendeskChat 2022-05-18 19:58:45 destination > 2022-05-18 19:58:39 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-05-18 19:58:45 destination > 2022-05-18 19:58:40 INFO i.a.i.b.IntegrationRunner(createSentryTransaction):339 - Sentry transaction event: 5a26958ff10e4849bae90c041f94a704 2022-05-18 19:58:45 destination > 2022-05-18 19:58:40 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-05-18 19:58:45 destination > 2022-05-18 19:58:40 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: WRITE 2022-05-18 19:58:45 destination > 2022-05-18 19:58:40 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-05-18 19:58:45 source > Syncing stream: accounts 2022-05-18 19:58:45 destination > 2022-05-18 19:58:40 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-05-18 19:58:45 destination > 2022-05-18 19:58:40 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-05-18 19:58:45 destination > 2022-05-18 19:58:40 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):281 - Selected loading method is set to: GCS 2022-05-18 19:58:45 destination > 2022-05-18 19:58:41 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):124 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=zendesk_chat, tableId=_airbyte_tmp_shg_accounts}} created successfully 2022-05-18 19:58:45 destination > 2022-05-18 19:58:41 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"AVRO","flattening":"No flattening","part_size_mb":"5"} 2022-05-18 19:58:45 destination > 2022-05-18 19:58:42 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):23 - Default schema. 2022-05-18 19:58:45 destination > 2022-05-18 19:58:42 INFO i.a.i.d.g.a.GcsAvroWriter():67 - Avro schema for stream accounts: {"type":"record","name":"accounts","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"_airbyte_data","type":"string"}]} 2022-05-18 19:58:45 destination > 2022-05-18 19:58:42 INFO i.a.i.d.g.a.GcsAvroWriter():73 - Full GCS path for stream 'accounts': hurb_airbyte/zendesk_chat_bigquery/accounts/2022_05_18_1652903921841_0.avro 2022-05-18 19:58:45 destination > 2022-05-18 19:58:42 INFO i.a.i.d.s.u.S3StreamTransferManagerHelper(getDefault):55 - PartSize arg is set to 5 MB 2022-05-18 19:58:45 destination > 2022-05-18 19:58:42 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to hurb_airbyte/zendesk_chat_bigquery/accounts/2022_05_18_1652903921841_0.avro with full ID ABPnzm4JQ6bHNsL8G1y3z-HOZ3r8DVS1OW-rozB_OAZGXtX7caTBjYaW7Al6HM57nEkaOuI 2022-05-18 19:58:45 destination > 2022-05-18 19:58:42 INFO i.a.i.d.g.w.BaseGcsWriter(initialize):73 - Overwrite mode 2022-05-18 19:58:45 destination > 2022-05-18 19:58:42 INFO i.a.i.d.g.w.BaseGcsWriter(initialize):90 - Overwrite is finished 2022-05-18 19:58:45 destination > 2022-05-18 19:58:42 INFO i.a.i.d.b.BigQueryUtils(isKeepFilesInGcs):297 - All tmp files will be removed from GCS when replication is finished 2022-05-18 19:58:45 source > Read 1 records from accounts stream 2022-05-18 19:58:45 source > Finished syncing accounts 2022-05-18 19:58:45 source > SourceZendeskChat runtimes: Syncing stream accounts 0:00:00.695058 2022-05-18 19:58:45 source > Finished syncing SourceZendeskChat 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):229 - The main thread is exiting while children non-daemon threads from a connector are still active. 2022-05-18 19:58:47 destination > Ideally, this situation should not happen... 2022-05-18 19:58:47 destination > Please check with maintainers if the connector or library code should safely clean up its threads before quitting instead. 2022-05-18 19:58:47 destination > The main thread is: main (RUNNABLE) 2022-05-18 19:58:47 destination > Thread stacktrace: java.base/java.lang.Thread.getStackTrace(Thread.java:1610) 2022-05-18 19:58:47 destination > at io.airbyte.integrations.base.IntegrationRunner.dumpThread(IntegrationRunner.java:264) 2022-05-18 19:58:47 destination > at io.airbyte.integrations.base.IntegrationRunner.watchForOrphanThreads(IntegrationRunner.java:233) 2022-05-18 19:58:47 destination > at io.airbyte.integrations.base.IntegrationRunner.runConsumer(IntegrationRunner.java:190) 2022-05-18 19:58:47 destination > at io.airbyte.integrations.base.IntegrationRunner.lambda$runInternal$1(IntegrationRunner.java:163) 2022-05-18 19:58:47 destination > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54) 2022-05-18 19:58:47 destination > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:38) 2022-05-18 19:58:47 destination > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:163) 2022-05-18 19:58:47 destination > at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:105) 2022-05-18 19:58:47 destination > at io.airbyte.integrations.destination.bigquery.BigQueryDestination.main(BigQueryDestination.java:262) 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-4-thread-1 (WAITING) 2022-05-18 19:58:47 destination > Thread stacktrace: java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:420) 2022-05-18 19:58:47 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:484) 2022-05-18 19:58:47 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-4-thread-2 (BLOCKED) 2022-05-18 19:58:47 destination > Thread stacktrace: app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:483) 2022-05-18 19:58:47 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-05-18 19:58:47 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 INFO i.a.i.d.b.BigQueryRecordConsumer(close):58 - Started closing all connections 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_accounts, tmpTable=_airbyte_tmp_shg_accounts, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.gcs.avro.GcsAvroWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.GcsAvroBigQueryRecordFormatter} 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 INFO i.a.i.d.g.w.BaseGcsWriter(close):120 - Uploading remaining data for stream 'accounts'. 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-05-18 19:58:47 destination > 2022-05-18 19:58:47 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to hurb_airbyte/zendesk_chat_bigquery/accounts/2022_05_18_1652903921841_0.avro with id ABPnzm4JQ...57nEkaOuI]: Uploading leftover stream [Part number 1 containing 0.00 MB] 2022-05-18 19:58:49 destination > 2022-05-18 19:58:49 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to hurb_airbyte/zendesk_chat_bigquery/accounts/2022_05_18_1652903921841_0.avro with id ABPnzm4JQ...57nEkaOuI]: Finished uploading [Part number 1 containing 0.00 MB] 2022-05-18 19:58:50 destination > 2022-05-18 19:58:50 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to hurb_airbyte/zendesk_chat_bigquery/accounts/2022_05_18_1652903921841_0.avro with id ABPnzm4JQ...57nEkaOuI]: Completed 2022-05-18 19:58:50 destination > 2022-05-18 19:58:50 INFO i.a.i.d.g.w.BaseGcsWriter(close):122 - Upload completed for stream 'accounts'. 2022-05-18 19:58:50 destination > 2022-05-18 19:58:50 INFO i.a.i.d.b.u.AbstractGscBigQueryUploader(uploadData):57 - Uploading data to the tmp table _airbyte_tmp_shg_accounts. 2022-05-18 19:58:50 destination > 2022-05-18 19:58:50 INFO i.a.i.d.b.u.AbstractGscBigQueryUploader(uploadDataFromFileToTmpTable):68 - Started copying data from gs://hurb_airbyte/zendesk_chat_bigquery/accounts/2022_05_18_1652903921841_0.avro GCS avro file to GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=zendesk_chat, tableId=_airbyte_tmp_shg_accounts}} tmp BigQuery table with schema: 2022-05-18 19:58:50 destination > Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]} 2022-05-18 19:58:50 destination > 2022-05-18 19:58:50 INFO i.a.i.d.b.u.AbstractGscBigQueryUploader(uploadDataFromFileToTmpTable):77 - Created a new job GCS avro file to tmp BigQuery table: Job{job=JobId{project=bi-data-science, job=d540cc44-f966-446d-a981-33ea315d11be, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1652903930607, endTime=null, startTime=1652903930725, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@bi-data-science.iam.gserviceaccount.com, etag=rCtbO50R3v36gKRDMACkfA==, generatedId=bi-data-science:US.d540cc44-f966-446d-a981-33ea315d11be, selfLink=https://www.googleapis.com/bigquery/v2/projects/bi-data-science/jobs/d540cc44-f966-446d-a981-33ea315d11be?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=zendesk_chat, projectId=bi-data-science, tableId=_airbyte_tmp_shg_accounts}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_TRUNCATE, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://hurb_airbyte/zendesk_chat_bigquery/accounts/2022_05_18_1652903921841_0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2022-05-18 19:58:50 destination > 2022-05-18 19:58:50 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):305 - Waiting for job finish Job{job=JobId{project=bi-data-science, job=d540cc44-f966-446d-a981-33ea315d11be, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1652903930607, endTime=null, startTime=1652903930725, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@bi-data-science.iam.gserviceaccount.com, etag=rCtbO50R3v36gKRDMACkfA==, generatedId=bi-data-science:US.d540cc44-f966-446d-a981-33ea315d11be, selfLink=https://www.googleapis.com/bigquery/v2/projects/bi-data-science/jobs/d540cc44-f966-446d-a981-33ea315d11be?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=zendesk_chat, projectId=bi-data-science, tableId=_airbyte_tmp_shg_accounts}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_TRUNCATE, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://hurb_airbyte/zendesk_chat_bigquery/accounts/2022_05_18_1652903921841_0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-05-18 19:58:52 destination > 2022-05-18 19:58:52 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):307 - Job finish Job{job=JobId{project=bi-data-science, job=d540cc44-f966-446d-a981-33ea315d11be, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1652903930607, endTime=null, startTime=1652903930725, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@bi-data-science.iam.gserviceaccount.com, etag=rCtbO50R3v36gKRDMACkfA==, generatedId=bi-data-science:US.d540cc44-f966-446d-a981-33ea315d11be, selfLink=https://www.googleapis.com/bigquery/v2/projects/bi-data-science/jobs/d540cc44-f966-446d-a981-33ea315d11be?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=zendesk_chat, projectId=bi-data-science, tableId=_airbyte_tmp_shg_accounts}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_TRUNCATE, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://hurb_airbyte/zendesk_chat_bigquery/accounts/2022_05_18_1652903921841_0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-05-18 19:58:52 destination > 2022-05-18 19:58:52 INFO i.a.i.d.b.u.AbstractGscBigQueryUploader(uploadDataFromFileToTmpTable):83 - Table is successfully overwritten by avro file loaded from GCS 2022-05-18 19:58:52 destination > 2022-05-18 19:58:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_shg_accounts to the source table _airbyte_raw_accounts. 2022-05-18 19:58:52 destination > 2022-05-18 19:58:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-05-18 19:58:55 destination > 2022-05-18 19:58:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=zendesk_chat, tableId=_airbyte_tmp_shg_accounts}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=zendesk_chat, tableId=_airbyte_raw_accounts}} 2022-05-18 19:58:55 destination > 2022-05-18 19:58:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_accounts! 2022-05-18 19:58:55 destination > 2022-05-18 19:58:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-05-18 19:58:55 destination > 2022-05-18 19:58:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-05-18 19:58:55 destination > 2022-05-18 19:58:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-05-18 19:58:55 destination > 2022-05-18 19:58:55 INFO i.a.i.d.b.u.AbstractGscBigQueryUploader(deleteGcsFiles):97 - Deleting file gs://hurb_airbyte/zendesk_chat_bigquery/accounts/2022_05_18_1652903921841_0.avro 2022-05-18 19:58:55 destination > 2022-05-18 19:58:55 INFO i.a.i.d.b.u.AbstractGscBigQueryUploader(lambda$deleteGcsFiles$1):110 - File is deleted : zendesk_chat_bigquery/accounts/2022_05_18_1652903921841_0.avro 2022-05-18 19:58:55 destination > 2022-05-18 19:58:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_accounts, tmpTable=_airbyte_tmp_shg_accounts, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.gcs.avro.GcsAvroWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.GcsAvroBigQueryRecordFormatter} 2022-05-18 19:58:55 destination > 2022-05-18 19:58:55 INFO i.a.i.b.IntegrationRunner(runInternal):169 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-05-18 19:59:02 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /config 2022-05-18 19:59:07 normalization > Namespace(config='destination_config.json', integration_type=, out='/config') 2022-05-18 19:59:07 normalization > transform_bigquery 2022-05-18 19:59:07 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /config --catalog destination_catalog.json --out /config/models/generated/ --json-column _airbyte_data 2022-05-18 19:59:08 normalization > Processing destination_catalog.json... 2022-05-18 19:59:08 normalization > Generating airbyte_ctes/zendesk_chat/accounts_ab1.sql from accounts 2022-05-18 19:59:08 normalization > Generating airbyte_ctes/zendesk_chat/accounts_ab2.sql from accounts 2022-05-18 19:59:08 normalization > Generating airbyte_ctes/zendesk_chat/accounts_ab3.sql from accounts 2022-05-18 19:59:08 normalization > Generating airbyte_tables/zendesk_chat/accounts.sql from accounts 2022-05-18 19:59:08 normalization > Generating airbyte_ctes/zendesk_chat/accounts_plan_ab1.sql from accounts/plan 2022-05-18 19:59:08 normalization > Generating airbyte_ctes/zendesk_chat/accounts_plan_ab2.sql from accounts/plan 2022-05-18 19:59:08 normalization > Generating airbyte_ctes/zendesk_chat/accounts_plan_ab3.sql from accounts/plan 2022-05-18 19:59:08 normalization > Generating airbyte_tables/zendesk_chat/accounts_plan.sql from accounts/plan 2022-05-18 19:59:08 normalization > Generating airbyte_ctes/zendesk_chat/accounts_billing_ab1.sql from accounts/billing 2022-05-18 19:59:08 normalization > Generating airbyte_ctes/zendesk_chat/accounts_billing_ab2.sql from accounts/billing 2022-05-18 19:59:08 normalization > Generating airbyte_ctes/zendesk_chat/accounts_billing_ab3.sql from accounts/billing 2022-05-18 19:59:08 normalization > Generating airbyte_tables/zendesk_chat/accounts_billing.sql from accounts/billing 2022-05-18 19:59:08 normalization > detected no config file for ssh, assuming ssh is off. 2022-05-18 19:59:13 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-05-18 19:59:13 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-05-18 19:59:13 normalization > 2022-05-18 19:59:13 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-05-18 19:59:13 normalization > 2022-05-18 19:59:18 normalization > 19:59:18 Running with dbt=1.0.0 2022-05-18 19:59:18 normalization > 19:59:18 Partial parse save file not found. Starting full parse. 2022-05-18 19:59:21 normalization > 19:59:21 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-05-18 19:59:21 normalization > There are 2 unused configuration paths: 2022-05-18 19:59:21 normalization > - models.airbyte_utils.generated.airbyte_incremental 2022-05-18 19:59:21 normalization > - models.airbyte_utils.generated.airbyte_views 2022-05-18 19:59:21 normalization > 2022-05-18 19:59:21 normalization > 19:59:21 Found 12 models, 0 tests, 0 snapshots, 0 analyses, 544 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2022-05-18 19:59:21 normalization > 19:59:21 2022-05-18 19:59:21 normalization > 19:59:21 Concurrency: 8 threads (target='prod') 2022-05-18 19:59:21 normalization > 19:59:21 2022-05-18 19:59:21 normalization > 19:59:21 1 of 3 START table model zendesk_chat.accounts.......................................................................... [RUN] 2022-05-18 19:59:24 normalization > 19:59:24 1 of 3 OK created table model zendesk_chat.accounts..................................................................... [CREATE TABLE (1.0 rows, 840.0 Bytes processed) in 2.83s] 2022-05-18 19:59:25 normalization > 19:59:25 2 of 3 START table model zendesk_chat.accounts_billing.................................................................. [RUN] 2022-05-18 19:59:25 normalization > 19:59:25 3 of 3 START table model zendesk_chat.accounts_plan..................................................................... [RUN] 2022-05-18 19:59:27 normalization > 19:59:27 3 of 3 OK created table model zendesk_chat.accounts_plan................................................................ [CREATE TABLE (1.0 rows, 761.0 Bytes processed) in 2.82s] 2022-05-18 19:59:28 normalization > 19:59:28 2 of 3 OK created table model zendesk_chat.accounts_billing............................................................. [CREATE TABLE (0.0 rows, 80.0 Bytes processed) in 3.21s] 2022-05-18 19:59:28 normalization > 19:59:28 2022-05-18 19:59:28 normalization > 19:59:28 Finished running 3 table models in 7.16s. 2022-05-18 19:59:28 normalization > 19:59:28 2022-05-18 19:59:28 normalization > 19:59:28 Completed successfully 2022-05-18 19:59:28 normalization > 19:59:28 2022-05-18 19:59:28 normalization > 19:59:28 Done. PASS=3 WARN=0 ERROR=0 SKIP=0 TOTAL=3