Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][Sort] The Pulsar connector on flink1.18 not set audit time, it should be set as input time through 'consume_time' metadata field #10623

Closed
2 tasks done
XiaoYou201 opened this issue Jul 14, 2024 · 0 comments · Fixed by #10624
Assignees
Milestone

Comments

@XiaoYou201
Copy link
Contributor

Description

The SourceMetricData not set timestamp as input time, So the report audit time will be wrong.It should be set through 'consume_time' metadata field as follow.

public abstract class ExtractNode implements Node {
public static final String INLONG_MSG = "inlong-msg";
public static final String INLONG_MSG_AUDIT_TIME = "value.data-time";
public static final String CONSUME_AUDIT_TIME = "consume_time";

reference kafka #10393

Use case

Pulsar source connector not attach input time when send audit information.

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants