AI in medical devices and its development future, as discussed by Nvidia's David Niewolny
In the rapidly evolving landscape of medical technology, Nvidia is making significant strides in integrating AI into various medical devices and clinical settings.
The tech giant, in partnership with Abridge, is gaining ground in hospitals by deploying its AI-powered clinical documentation system. This system, integrated with major Electronic Health Records (EHRs), promises to streamline clinical workflows and improve the accuracy of diagnoses.
Nvidia's role in the integration of AI in medical devices is pivotal. By providing advanced AI computing infrastructure, hardware, and software platforms, Nvidia enables real-time, edge-based AI processing for clinical applications. Notable examples include the Blackwell-powered DGX SuperPOD and DGX B200 servers, which are used by leading medical institutions like the Mayo Clinic to build scalable AI infrastructure for multimodal and generative AI models in pathology, drug discovery, and precision medicine.
Collaborations with medical device companies like Medtronic further cement Nvidia's position. The partnership sees Nvidia supplying the IGX industrial-grade edge AI hardware and Holoscan real-time AI software platform, powering intelligent medical devices such as the GI Genius™ endoscopy module to deploy complex AI algorithms at the clinical edge.
The potential applications of Agentic AI—AI systems capable of autonomous decision-making and action—in the medtech industry are vast. They include enhancing diagnostic accuracy, personalizing treatment plans, improving operational efficiency, and accelerating drug discovery. For instance, generative AI models can automate pathology slide analysis, as seen in Mayo Clinic's Atlas model trained on over 1.2 million pathology slides, thereby reducing clinicians’ workload and improving diagnostic precision.
The future of AI in medical devices is promising, with a focus on physical AI, particularly in the field of robotics. This includes surgical AI and operational robotics like nurse assistants. Moon Surgical, another partner of Nvidia, has downloaded their instructions for use manual into an AI agent that can assist doctors and surgeons with setup and best practices.
Nvidia's commitment to healthcare robotics is evident in the debut of Isaac for Healthcare, a new developer framework unveiled in March. This framework features three computers for synthetic data generation, virtual environment creation, and application deployment.
Other collaborations include Nvidia's work with J&J on the Monarch platform for bronchoscopy and with Philips on foundation models for MRI machines. The rapid progression in healthcare and medtech adopting generative AI has been observed in the last 18 months.
The FDA has also joined the fray, appointing a chief AI officer to speed up scientific reviews. This move signals a recognition of the transformative potential of AI in medical technology and a commitment to fostering its growth.
As discussions about the booming growth of AI in medtech and new devices in this field continue, it's clear that Nvidia is at the forefront of this revolution. With partnerships with various medtech companies, including Abridge and Moon Surgical, Nvidia is integrating AI technology into clinical documentation, surgical assistance, and device setup manuals, promising a future of better patient outcomes, streamlined clinical workflows, and enabling precision medicine by tailoring treatments to individual patients’ data signatures.
References:
[1] Nvidia. (n.d.). NVIDIA and GE Healthcare Collaborate to Develop Autonomous X-ray and Ultrasound Solutions. Retrieved from https://www.nvidia.com/en-us/about-nvidia/news/nvidia-and-ge-healthcare-collaborate-to-develop-autonomous-x-ray-and-ultrasound-solutions/
[2] Nvidia. (n.d.). NVIDIA Collaborates with Medtronic to Accelerate the Development of AI-Powered Medical Devices. Retrieved from https://www.nvidia.com/en-us/about-nvidia/news/nvidia-collaborates-with-medtronic-to-accelerate-the-development-of-ai-powered-medical-devices/
[3] Mayo Clinic. (n.d.). Mayo Clinic and NVIDIA Partner to Advance AI Research in Healthcare. Retrieved from https://newsnetwork.mayoclinic.org/discussion/mayo-clinic-and-nvidia-partner-to-advance-ai-research-in-healthcare/
[4] Medtronic. (n.d.). Medtronic and NVIDIA Collaborate to Advance AI in Healthcare. Retrieved from https://www.medtronic.com/us-en/about-medtronic/news/press-releases/2020/09/medtronic-and-nvidia-collaborate-to-advance-ai-in-healthcare.html
- Nvidia is integrating AI technology into clinical documentation, surgical assistance, and device setup manuals through partnerships with companies like Abridge and Moon Surgical.
- The tech giant's AI-powered clinical documentation system, integrating with major Electronic Health Records (EHRs), aims to streamline clinical workflows and enhance diagnostic accuracy.
- The FDA has recognized the transformative potential of AI in medical technology and appointed a chief AI officer to speed up scientific reviews.
- Nvidia's commitment to healthcare robotics is highlighted by the launch of Isaac for Healthcare, a new developer framework for synthetic data generation, virtual environment creation, and application deployment.
- Leading medical institutions like the Mayo Clinic use Nvidia's advanced AI computing infrastructure and hardware like the DGX SuperPOD and DGX B200 servers for building scalable AI infrastructure for multimodal and generative AI models in pathology, drug discovery, and precision medicine.
- Collaborations between Nvidia and companies like Medtronic and Philips focus on accelerating the development of AI-powered medical devices and foundation models for imaging technology like MRI machines.
- News of rapid progression in healthcare and medtech adopting generative AI in the last 18 months has been observed, with a growing focus on physical AI and robotics in fields such as surgical AI and operational robotics aiding nurses.
