Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bugfix/health checks #616

Merged
merged 6 commits into from
Nov 30, 2022
Merged

Bugfix/health checks #616

merged 6 commits into from
Nov 30, 2022

Conversation

Phencys
Copy link
Collaborator

@Phencys Phencys commented Nov 18, 2022

Added a 30 second timeout / 60 second kill timeout on the segment validator, to prevent it from running indefinitely.

Added a category of "health" checks to the logger module, to message various issues with the segment validator:

  • The segment validator took too long and is killed
  • The resulting XML file is > 100mb. (There is a set of test files that generate 2GB files of whitespace)
  • The resulting XML is invalid XML

On health issues with the segment validator, segment validation is skipped for the remainder of the run.

This should address - at least a part of - issue #602

Also added some minor rewrites to address issues #612 and #614

@Phencys Phencys requested review from aldafu and dsilhavy November 18, 2022 08:10
@dsilhavy dsilhavy added this to the v2.1.0 milestone Nov 30, 2022
@dsilhavy dsilhavy merged commit 047a14a into development Nov 30, 2022
@dsilhavy dsilhavy deleted the bugfix/healthChecks branch December 5, 2022 09:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants