Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optional support for instance segmentation #97

Open
dlangenk opened this issue Feb 18, 2022 · 4 comments
Open

Optional support for instance segmentation #97

dlangenk opened this issue Feb 18, 2022 · 4 comments

Comments

@dlangenk
Copy link
Member

If we use Mask R-CNN anyway for detection we could support instance segmentation if the data is present. This would be more easy in connection with the data import #95 (for example dino would be able to generate more fine grained annotation candidates instead of the autoencoder) and the framework change #96 (if we change the framework we have to rewrite some code anyway).

@mzur
Copy link
Member

mzur commented Sep 6, 2023

Segment Anything could be used to generate segmentation masks based on the MAIA circles as prompts. This would work even without masks as training data (which was the main argument against segmentation because masks are hard to draw manually).

@dlangenk
Copy link
Member Author

dlangenk commented Sep 6, 2023

I'm not sure if it doesn't work better the other way, so use SAM to create more or less accurate training data and create accurate prediction masks. In addition the compute load is much less as usually #trainingData << #predictedData

@dlangenk
Copy link
Member Author

dlangenk commented Sep 7, 2023

A student of mine has developed some heuristics to improve the conversion of a point in his case to a polygon. But I guess most of these are also applicable to circles.

@mzur mzur moved this to Medium Priority in BIIGLE Roadmap Nov 8, 2024
@mzur mzur removed the discuss label Nov 8, 2024
@mzur
Copy link
Member

mzur commented Nov 8, 2024

Segmentation with MAIA using SAM is now on the roadmap again (as we plan to implement the point to polygon feature elsewhere in BIIGLE, too).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Medium Priority
Development

No branches or pull requests

2 participants