Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source MySQL: check pod on completed status #17576

Closed
caiohasouza opened this issue Oct 4, 2022 · 6 comments
Closed

Source MySQL: check pod on completed status #17576

caiohasouza opened this issue Oct 4, 2022 · 6 comments
Labels
area/connectors Connector related issues community connectors/source/mysql connectors/sources-database releaseStage/beta team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working

Comments

@caiohasouza
Copy link
Contributor

Environment

  • Airbyte version: 0.40.10
  • OS Version / Instance: Kubernetes
  • Deployment: Helm Chart
  • Source Connector and version: mysql 0.6.14
  • Step where error happened: Sync

Current Behavior

When i will test the source mysql connection the new pod is created (source-mysql-check-bfc7dadf-5ce5-4a52-9bd9-0ddaaac98491-0-gxmqe), the test is finished but the pod still on completed status.

Expected Behavior

I expect that pod would be removed when the test is finished.

Logs

airbyte.log

@marcosmarxm
Copy link
Member

There is a service called pod-sweeper which cleans every 2 hours the completed/failed pods.

@caiohasouza
Copy link
Contributor Author

Hi @marcosmarxm

Ok, ant it's possible change this schedule?

@marcosmarxm
Copy link
Member

The logic is executed here: https://github.com/airbytehq/airbyte/blob/master/charts/airbyte-pod-sweeper/files/sweep-pod.sh
Not sure if it's possible without rebuilding the helm chart. Do you mind create an issue or look for one that is asking to let this variable as a parameter?

@caiohasouza
Copy link
Contributor Author

Hi @marcosmarxm ,

I got it, i created a PR with this feature (#17985), could you check please? I already tested locally.

Regards

@igrankova igrankova changed the title Source check pod on completed status Source MySQL: check pod on completed status Jun 6, 2023
@igrankova igrankova added area/connectors Connector related issues connectors/sources-database connectors/source/mysql team/db-dw-sources Backlog for Database and Data Warehouse Sources team releaseStage/beta and removed needs-triage team/tse Technical Support Engineers autoteam labels Jun 6, 2023
@prateekmukhedkar
Copy link
Contributor

@caiohasouza Are you still experiencing this issue? We implemented the pod sweeper PR, and I will close this issue if I don't hear back from you. Thanks

@caiohasouza
Copy link
Contributor Author

Hi @prateekmukhedkar

No, all works fine now, thank you!

Regards

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues community connectors/source/mysql connectors/sources-database releaseStage/beta team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

5 participants