Skip to content

Update SAM AMG README with more descriptive install instructions #1337

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
Dec 9, 2024

Conversation

philipbutler
Copy link
Contributor

@cpuhrsch
Installing was not so obvious, so this should help others trying to test and contribute.

There's some extra commits from amending, I'm still kinda garbage at git

Copy link

pytorch-bot bot commented Nov 24, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/1337

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures

As of commit 3dcb54f with merge base ed76e9c (image):

NEW FAILURES - The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 24, 2024
python setup.py develop

# On your mark, get set...
cd examples/sam2_amg_server/
```

Download `sam2.1_hiera_large.pt` from https://github.com/facebookresearch/sam2?tab=readme-ov-file#download-checkpoints and put it into `~/checkpoints/sam2`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The download part I guess doesn't apply anymore now that the user can get this via the model type argument.

@cpuhrsch
Copy link
Contributor

Looks good, let me know once you got a chance to give this another commit or two and then we can merge.

@@ -2,18 +2,18 @@

# Model
model:
_target_: sam2.modeling.sam2_base.SAM2Base
_target_: torchao._models.sam2.modeling.sam2_base.SAM2Base
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, these are the sam2 configs. There's sam2 and then there's sam2.1. I had to switched to sam2.1, but maybe sam2 is still useful? I updated the sam2.1 configs in b2e42ff#diff-12caf984b30e7028df7fb867a984c5ccad3fde0a0783df2af26db9cef860fbe5 , but in any case it doesn't hurt to have sam2 support as well.

yanbing-j pushed a commit to yanbing-j/ao that referenced this pull request Dec 9, 2024
…h#1337)

* [AOTI] Remove the original model weights in Python deployment

Summary: Fixes pytorch/torchchat#1302. Because AOTI-compiled model contains a copy of model weights, we need to release the corresponding eager model weights in the Python deployment path.

* Revert "[AOTI] Remove the original model weights in Python deployment"

This reverts commit 962ec0d913bbf6c30496560f12b4726445dce7da.

* Refactor the code

* Add setup_cache for aoti_package_path

---------

Co-authored-by: Jack-Khuu <jack.khuu.7@gmail.com>
Copy link

@bhack bhack left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we recap in the Readme also the optimizations we have introduced with AO?

@cpuhrsch
Copy link
Contributor

cpuhrsch commented Dec 9, 2024

@bhack - Yes, we're working a more detailed description of this.

@cpuhrsch cpuhrsch added the topic: improvement Use this tag if this PR is an improvement (doesn't fit into any of the other categories) label Dec 9, 2024
@cpuhrsch cpuhrsch merged commit a6f8676 into pytorch:main Dec 9, 2024
16 of 18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. topic: improvement Use this tag if this PR is an improvement (doesn't fit into any of the other categories)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants