Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance not comparable to the co-responding research paper #23

Open
EthicalAccount opened this issue Jun 12, 2024 · 0 comments
Open

Comments

@EthicalAccount
Copy link

I was not able to reproduce the results that were provided in the research paper.

Using Mamba pretrained model, the results were not satisfactory and were significantly lower as compared to the proposed values.
Screenshot (1) N
These results were of Mamba using pre-trained checkpoint weight.

I also tried using simple UNet architecture and it too had performance degradation, while also simultaneously performing better than Mamba-UNet
Screenshot (2)

The dataset used was ACDC and segmentation task was performed upon it.

It also took significantly longer for mamba tiny to train (around 20 hours)
Specifications
CPU: Intel i9-11900K
RAM: 64 GB DDR4
GPU: RTX 3070 8GB

Everything ran on default settings with the parameters cross-validated as provided in the research paper.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant