by By Amboni
Google Cloud is upgrading its Vertex AI search platform for healthcare by adding multimodal AI features. One of the new tools, Visual Q&A, will let users search through tables, charts, and diagrams.
This is important because healthcare still isn’t fully digital, with patient records spread across different data sources and formats. Much of the critical information, like diagnostic tables, is still on paper, requiring manual scanning and data entry into electronic records.
A recent study shows that imaging data makes up nearly 90% of all healthcare data. A significant source of critical clinical information, medical imaging is highlighted as a key area of focus. The authors note that while AI’s success so far has mainly been focused on analyzing traditional big data, “medical imaging presents unique challenges for deep learning techniques.” As a result, this area has become the next frontier for many healthcare companies.
Multimodal AI with Visual Q&A allows clinicians to input images and diagrams, which are analyzed and included in search results.
Source: forbes inside tech, Google update
