Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] oracle cdc Connection number problem #1905

Closed
1 of 2 tasks
Soulmate76 opened this issue Feb 9, 2023 · 2 comments
Closed
1 of 2 tasks

[Bug] oracle cdc Connection number problem #1905

Soulmate76 opened this issue Feb 9, 2023 · 2 comments
Labels
bug Something isn't working

Comments

@Soulmate76
Copy link

Search before asking

  • I searched in the issues and found nothing similar.

Flink version

1.14.6

Flink CDC version

2.3

Database and its version

oraclce 11.2.0.4.0

Minimal reproduce step

image
In the full-volume phase, the data volume is about 3G. With the completion of chunk division and the transfer to the downstream, the number of oracle database connections is increasing according to the division of chunk to pull data, and the previous connections will not be released no matter whether the full data is being pulled or the full data is converted into an increment. The database failed due to excessive connections. No solution can be found.Oracle cdc is simply not usable with large amounts of data

What did you expect to see?

Are there any Settings to control the number of connections or to release connections?

What did you see instead?

I tried to fix the problem from the source code, but saw that pulling data from the oracle database didn't seem to use connection pooling, and while the code showed that the connection was shared, it wasn't in health!!

Anything else?

The execute() method is called in the source code, but I added log printing to all the execute() methods in oracle cdc, and found that all the execute() methods did not print the log I added at runtime, that is, all execute() methods did not enter, which was very confusing. Want to modify but can't start!!
image

Are you willing to submit a PR?

  • I'm willing to submit a PR!
@Soulmate76 Soulmate76 added the bug Something isn't working label Feb 9, 2023
@lujiujiuyj
Copy link

mark!

@ruanhang1993
Copy link
Contributor

Fix in #2254

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants