-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Ensure incompletely extracted bin files get re-extracted #392
Conversation
…json creation time
@ngreenwald with this PR, your STANFORD cohort stitched images don't show the corrupted artifacts on the bottom of images anymore. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just an additional test suggestion.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just some docs. Looks good otherwise.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice stuff
What is the purpose of this PR?
Closes #389. In some cases, even if the
.json
file is written for a FOV during a MIBI run, the.bin
file will not have been fully copied over. The watcher needs to account for these cases because otherwise, the data extracted from the.bin
file will be incomplete, leading to the artifacts highlighted in the issue.How did you implement your changes
When the control statement in
check_complete
runs, one final pass of all the FOVs needs to be conducted. Offending.bin
files will have their created timestamp be later than their modified timestamp, in which case, the.bin
file is once again thrown into the extraction pipeline.Remaining issues
Full testing needs to be conducted on @ngreenwald's cohort.