-
Notifications
You must be signed in to change notification settings - Fork 336
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BitSail][Connector] Support Pulsar source connector #123
Comments
I'd like to take this issue. |
A sample job config is as follows: {
"job": {
"common": {
"job_type": "STREAMING",
"job_plugin_lib_dir": "plugin",
"job_plugin_conf_dir": "plugin_conf",
"enable_dynamic_loader": true,
"instance_id": "1",
"internal_instance_id": "1",
"extra_properties": {
"update-mode": "append"
}
},
"reader": {
"pulsar": {
"source": {
"enableAutoAcknowledgeMessage": true
},
"client": {
"serviceUrl": "pulsar://lcoalhost:8080"
},
"admin": {
"adminUrl": "http://localhost:6650",
"topics": "TBW102",
"topicMode": "list"
},
"consumer": {
"startCursorMode": "latest",
"subscriptionType": "Exclusive"
}
},
"columns": [
{
"name": "ID",
"type": "string"
}
],
"format_type": "json",
"class": "com.bytedance.bitsail.connector.pulsar.source.PulsarSourceV1"
},
"writer": {
"class": "com.bytedance.bitsail.connector.legacy.print.sink.PrintSink"
}
}
} P.S., I always get the slf4j warnings |
Added pulsar source v1 Pulsar source connector adapt to bitsail v1 source reader. Wired up bitsail config for Pulsar connector Simple implementation of pollNext function in Pulsar connector
Added pulsar source v1 Pulsar source connector adapt to bitsail v1 source reader. Wired up bitsail config for Pulsar connector Simple implementation of pollNext function in Pulsar connector
@qidian99 assigned to you! |
Reminder, is there any problem encountered in this task, we can discuss it together @qidian99 |
Is your feature request related to a problem? Please describe
A clear and concise description of what the problem is.
Example: I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
The text was updated successfully, but these errors were encountered: