Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bugfix/bad records #438

Merged
merged 2 commits into from
Apr 1, 2024
Merged

Bugfix/bad records #438

merged 2 commits into from
Apr 1, 2024

Conversation

RemingtonRohel
Copy link
Contributor

This PR aims to fix the intermittent issue in the develop branch where zero-sequence records throw an IndexError when being written to file.

  • Added a check to write_hdf5_file() in data_write.py that will circumvent the IndexError.
  • Created custom __repr__ method that won't fail due to missing attributes, and instead prints all attributes set.

@RemingtonRohel RemingtonRohel changed the base branch from main to develop March 22, 2024 18:51
* Custom __repr__ for SliceData that should display all variables set
* Added a check to write_hdf5_file() that should circumvent the IndexError
@RemingtonRohel RemingtonRohel linked an issue Mar 22, 2024 that may be closed by this pull request
@RemingtonRohel RemingtonRohel added the quick review A quick to review PR label Mar 22, 2024
@RemingtonRohel
Copy link
Contributor Author

Currently running on PGR to monitor over the weekend. Hopefully, the warning will log but the files will still pass through the dataflow without issue.

@RemingtonRohel
Copy link
Contributor Author

RemingtonRohel commented Mar 28, 2024

The warning has appeared a few dozen times at PGR since I've pulled the branch there; none of the files have failed to convert or raised exceptions when passed through the data flow. I recommend we proceed with this PR.

@RemingtonRohel RemingtonRohel marked this pull request as ready for review March 28, 2024 20:44
Copy link
Contributor

@tjk584 tjk584 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should make an issue to resolve the root of this problem, if there isn't already one

@RemingtonRohel
Copy link
Contributor Author

We should make an issue to resolve the root of this problem, if there isn't already one

#444

@RemingtonRohel RemingtonRohel merged commit b6d2201 into develop Apr 1, 2024
@RemingtonRohel RemingtonRohel deleted the bugfix/bad_records branch April 1, 2024 20:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
quick review A quick to review PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Records sometimes missing fields (develop branch)
2 participants