A related paper : region clip

[rom1504]

Hi,
Cool repo and notebooks !

I think you could be interested by https://arxiv.org/abs/2112.09106v1 (region clip), they use basically the same method as you to build a region-concept dataset then use that to train a better model