In a recent study published in the journal Nature Medicine, researchers describe the development of a multi-modal extension of the Articulate Medical Intelligence Explorer, or AMIE. The model is designed to utilize a state-aware reasoning framework to manage clinical conversations and interpret visual artifacts. The study subsequently conducted a randomized, blinded exploratory study involving 105 multi-modal clinical scenarios, yielding 210 simulated telehealth consultations, in which AMIE’s performance was compared with that of 19 board-certified primary care physicians (PCPs).
Study findings revealed that the novel multi-modal model outperformed PCPs across 29 of 32 evaluation axes, including diagnostic accuracy and consultation-quality metrics such as empathy. These findings suggest that multi-modal AI could eventually support remote healthcare delivery, pending real-world validation.
Read Full Article Here
