Dose this repo support tracking in video?

[KainingYing]

No description provided.

[bhack]

Tracking will require to use these embeddings in another type of network.

See the upstream ticket facebookresearch/segment-anything#152 (comment)

[kadirnar]

@bhack , @KainingYing

Which tracking algorithm do you want? Have you looked at the Torchyolo library? I added the tracker library for Yolo models.

https://github.com/kadirnar/torchyolo

My Tracker Repos:

https://github.com/kadirnar/Norfair-Track
https://github.com/kadirnar/ocsort-pip
https://github.com/kadirnar/bytetrack-pip
https://github.com/kadirnar/strongsort-pip
https://github.com/kadirnar/sort-pip

[kadirnar]

I added the SAHI algorithm for small object detection.

https://github.com/kadirnar/segment-anything-video#sahi--segment-anything

[bhack]

These tracking algorithms are good but I don't think are related to masks tracking/propagation.

See the upstream ticket specific datasets and they related leaderboards.

[KainingYing]

thanks

[bhack]

@kadirnar With you algos you can reproduce something like:
https://github.com/yahooo-mds/OSTrack_SAM

But it will not have the quality and temporal consistency as using the embedding with VOS specific networks like the ones performing in the mentioned datasets.

[kadirnar]

@kadirnar With you algos you can reproduce something like: https://github.com/yahooo-mds/OSTrack_SAM

But it will not have the quality and temporal consistency as using the embedding with VOS specific networks like the ones performing in the mentioned datasets.

#6 (comment)

[kadirnar]

Track-Sam: https://github.com/gaomingqi/Track-Anything

[egeozguroglu]

Dear @kadirnar, you've linked the Track Anything repository in your comment above, which interestingly has the exact metaseg demo in their repo (demo.py). To clarify: (1) Does metaseg support tracking of segmentation masks through videos? (2) Is there a link between metaseg and Track Anything?

[kadirnar]

The Metaseg library does not have a tracker feature. You can view the feature list here:
https://github.com/kadirnar/segment-anything-video#extra-features

The Track-Anything repo used to use the metaseg library but no longer does.