-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Optional support for instance segmentation #97
Comments
Segment Anything could be used to generate segmentation masks based on the MAIA circles as prompts. This would work even without masks as training data (which was the main argument against segmentation because masks are hard to draw manually). |
I'm not sure if it doesn't work better the other way, so use SAM to create more or less accurate training data and create accurate prediction masks. In addition the compute load is much less as usually #trainingData << #predictedData |
A student of mine has developed some heuristics to improve the conversion of a point in his case to a polygon. But I guess most of these are also applicable to circles. |
Segmentation with MAIA using SAM is now on the roadmap again (as we plan to implement the point to polygon feature elsewhere in BIIGLE, too). |
If we use Mask R-CNN anyway for detection we could support instance segmentation if the data is present. This would be more easy in connection with the data import #95 (for example dino would be able to generate more fine grained annotation candidates instead of the autoencoder) and the framework change #96 (if we change the framework we have to rewrite some code anyway).
The text was updated successfully, but these errors were encountered: