wip: integration of ip-adapter #900

Job	Run time
Build Wheel	19s
publish-docs	0s
test-gpu	11m 10s
lint	14s
test-non-gpu (3.10, ubuntu-latest)	1m 47s
type-check	2m 58s
test-non-gpu (3.11, ubuntu-latest)	1m 24s
Smoketest (Conda, Python 3.10, ubuntu-latest)	18m 52s
Smoketest (Python 3.10, ubuntu-latest)	8m 20s
Smoketest (Conda, Python 3.10, windows-latest)	4m 3s
Smoketest (Conda, Python 3.10, macos-latest)	11m 43s
Smoketest (Python 3.10, windows-latest)	2m 15s
Smoketest (Python 3.10, macos-latest)	11m 34s
Smoketest (Conda, Python 3.11, ubuntu-latest)	8m 23s
Smoketest (Conda, Python 3.11, windows-latest)	4m 36s
Smoketest (Python 3.11, ubuntu-latest)	11m 41s
Smoketest (Python 3.11, windows-latest)	3m 43s
Smoketest (Conda, Python 3.11, macos-latest)	16m 5s
Smoketest (Python 3.11, macos-latest)	9m 16s
	2h 8m 23s

Provide feedback