Code

Provide feature file event provider#678

Code

Draft

parisni wants to merge 35 commits intoconfluentinc:masterconfluentinc/kafka-connect-storage-cloud:masterfrom leboncoin:feat/partition-file-callbackleboncoin/kafka-connect-storage-cloud:feat/partition-file-callbackCopy head branch name to clipboard

+946-25

Commits

Commits on Jul 11, 2023

• Add new file callback configs

  parisni

  committed
  6f2d87a

  Copy full SHA for 6f2d87a

• Add file callback interface/ dummy impl

  parisni

  committed
  b95f4e0

  Copy full SHA for b95f4e0

• Add first callback call

  parisni

  committed
  9b81126

  Copy full SHA for 9b81126

• Init callback in constructor

  parisni

  committed
  06057ed

  Copy full SHA for 06057ed

• Add kafka configs

  parisni

  committed
  cdd4a5e

  Copy full SHA for cdd4a5e

• WIP: Add kafka producer

  parisni

  committed
  f9c1201

  Copy full SHA for f9c1201

Commits on Jul 26, 2023

• Use MinioContainer as replacement of real S3

  Show description for a9728db
  parisni

  committed
  a9728db

  Copy full SHA for a9728db

• Test callback on embedded kafka w/ string serializer

  parisni

  committed
  14cfc09

  Copy full SHA for 14cfc09

• Turn value into avro serde

  parisni

  committed
  e2ac130

  Copy full SHA for e2ac130

Commits on Jul 28, 2023

• Build avsc from maven

  parisni

  committed
  34ceb09

  Copy full SHA for 34ceb09

• Allow to skip errors

  Show description for f8fa534
  parisni

  committed
  f8fa534

  Copy full SHA for f8fa534

• Implement security

  parisni

  committed
  ea1b58e

  Copy full SHA for ea1b58e

• Fix style

  parisni

  committed
  71eb9f6

  Copy full SHA for 71eb9f6

• Add k-connect test and fix impl

  parisni

  committed
  4dbe5f6

  Copy full SHA for 4dbe5f6

• Add timebasedpartitioner to get ts

  parisni

  committed
  3010b54

  Copy full SHA for 3010b54

• Document the avro record

  parisni

  committed
  b1dc388

  Copy full SHA for b1dc388

Commits on Aug 17, 2023

• Use avro to serialize key

  parisni

  committed
  dae74e2

  Copy full SHA for dae74e2

• Add event datetime

  parisni

  committed
  cec27e7

  Copy full SHA for cec27e7

Commits on Aug 22, 2023

• Add logs and fix it

  parisni

  committed
  48f8536

  Copy full SHA for 48f8536

Commits on Aug 25, 2023

• Rm useless imports

  parisni

  committed
  5379081

  Copy full SHA for 5379081

Commits on Aug 31, 2023

• Rename callback to file-event

  parisni

  committed
  a9288c7

  Copy full SHA for a9288c7

Commits on Sep 1, 2023

• Use snake case

  parisni

  committed
  62ef7dd

  Copy full SHA for 62ef7dd

• Separate config and security file event

  parisni

  committed
  48da579

  Copy full SHA for 48da579

• Revert "Separate config and security file event"

  Show description for b3e0eaa
  parisni

  committed
  b3e0eaa

  Copy full SHA for b3e0eaa

Commits on Sep 4, 2023

• File event (#1)

  parisni

  authored
  2505921

  Copy full SHA for 2505921

Commits on Sep 7, 2023

• Fix typo sasl mechanism

  parisni

  committed
  b854cdf

  Copy full SHA for b854cdf

Commits on Sep 8, 2023

• Use string serializer for key

  parisni

  committed
  f38d201

  Copy full SHA for f38d201

• Disable auto create topic/registry schema

  parisni

  committed
  d46be93

  Copy full SHA for d46be93

Commits on Sep 12, 2023

• Allow to provide custom kafka configs

  parisni

  committed
  d22dc90

  Copy full SHA for d22dc90

• Reuse kafka producer at task level

  parisni

  committed
  3d1a180

  Copy full SHA for 3d1a180

Commits on Sep 15, 2023

• Fix the file event life cycle

  parisni

  committed
  b5de512

  Copy full SHA for b5de512

Commits on Feb 12, 2024

• Fix record counts.

  Show description for 1fd0c65
  parisni

  committed
  1fd0c65

  Copy full SHA for 1fd0c65

Commits on Mar 13, 2024

• Add db/tbl to the output topic

  parisni

  committed
  74c8f2d

  Copy full SHA for 74c8f2d

Commits on Mar 14, 2024

• Don't fail on unknown properties

  parisni

  committed
  961852b

  Copy full SHA for 961852b

Commits on Jul 26, 2024

• chore: merge master

  

  Guillaume SANON

  committed
  317ceb8

  Copy full SHA for 317ceb8