Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Query and monitor if we have skipped any scheduled jobs #15256

Merged
merged 30 commits into from
Aug 8, 2022

Conversation

xiaohansong
Copy link
Contributor

What

https://github.com/airbytehq/airbyte-cloud/issues/2225

Monitor if we have skipped any scheduled jobs

@github-actions github-actions bot added area/platform issues related to the platform area/worker Related to worker labels Aug 3, 2022
@github-actions github-actions bot removed area/platform issues related to the platform area/worker Related to worker labels Aug 3, 2022
@xiaohansong xiaohansong temporarily deployed to more-secrets August 3, 2022 18:25 Inactive
@xiaohansong xiaohansong requested review from a team and git-phu and removed request for a team August 3, 2022 18:33
@xiaohansong xiaohansong marked this pull request as ready for review August 3, 2022 18:33
@xiaohansong xiaohansong changed the title Xiaohan/metricsync Query and monitor if we have skipped any scheduled jobs Aug 3, 2022
@xiaohansong xiaohansong temporarily deployed to more-secrets August 3, 2022 18:35 Inactive
@@ -148,4 +148,44 @@ public static List<Pair<JobStatus, Double>> overallJobRuntimeForTerminalJobsInLa
return pairedRes;
}

public static Long numOfJobsNotRunningOnSchedule(final DSLContext ctx) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we have any kind of testing for these queries?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not in unit test I'm afraid... but I ran these manually on dbeaver.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok, should we add a comment about what our logic is for determining if a job run was missed?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

make sense. I have a runbook coming in https://github.com/airbytehq/airbyte-cloud/pull/2272; I'll add a short summary here.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh ok perfect, thanks!

@xiaohansong xiaohansong temporarily deployed to more-secrets August 8, 2022 17:41 Inactive
@xiaohansong xiaohansong temporarily deployed to more-secrets August 8, 2022 17:56 Inactive
@xiaohansong xiaohansong merged commit c582901 into master Aug 8, 2022
@xiaohansong xiaohansong deleted the xiaohan/metricsync branch August 8, 2022 20:57
@xiaohansong xiaohansong temporarily deployed to more-secrets August 8, 2022 20:58 Inactive
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants