Microsoft researchers have unveiled Visual ChatGPT, an open-source extension that links an AI dialogue system to numerous Visual Foundation Models, allowing for the exchange of images.
Currently, ChatGPT is incapable of generating or manipulating images; it may well only describe them, which may then be used with tools like Stable Diffusion, DALL-E, or Midjourney. But with the Visual ChatGPT project, the AI system gains the flexibility to supply images, make edits, remove objects, and perform other similar tasks.
Visual ChatGPT allows:
- sending and receiving not only languages but additionally images;
- providing complex visual questions or visual editing instructions that require the collaboration of multiple AI models with multi-steps;
- providing feedback and asking for corrected results.
Find the project on GitHub
Read the paper Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models
Know More about GPT: https://twitter.com/BeingOvee/status/1634211136836079618
Find me on: Twitter | Linkedin | Instagram | Facebook | Pinterest