[Flux IPadapter] Support Xlabs IPadapter in diffusers #9403
Description
It'd be great to have XLabs IPadapter supported in diffusers.
Code: https://github.com/XLabs-AI/x-flux/
Checkpoint: https://huggingface.co/XLabs-AI/flux-ip-adapter/tree/main