To use the gradio demo code of ControlCap, please install the following packages:
pip install gradio==3.50.0
pip install git+https://github.com/facebookresearch/segment-anything.git
Then, download a segment anything model and place it into ckpts/sam_vit_b_01ec64.pth.
Finally, run the following command to launch the gradio demo:
bash scripts/demo.sh