Multimodal AI

A model that handles more than one kind of input or output — text, images, audio, video.

Multimodal models map different data types into a shared representation, so you can hand one a screenshot and a question and get a text answer. The practical upshot is that whiteboards, PDFs, and voice all become valid inputs, which removes the transcription step from a lot of workflows.

In practice: Photographing a broken chart in a slide deck and asking what is wrong with it.