New Nvidia Isaac autonomous imaging system and new to rapid development for robotics development for healthcare medical device simulation platforms
GTC—Nvidia today announced a collaboration with GE Healthcare to promote innovation in autonomous imaging, focusing on developing autonomous X-ray technology and ultrasound applications.
Building autonomy in systems such as x-rays and ultrasound requires medical imaging systems to understand and operate in the physical world. This allows for the automation of complex workflows such as patient placement, image scanning, and quality checks.
To achieve this, pioneering partner GE Healthcare is using the healthcare medical device simulation platform for its new NVIDIA ISAAC™. The platform accelerates R&D workflows and enables GE Healthcare to train, test and validate autonomous imaging system capabilities in virtual environments before it unfolds in the physical world.
“We're excited to be able to help you get started,” said Kimberly Powell, Vice President of Health Care at NVIDIA. “We are working with industry leader GE Healthcare to provide Healthcare's ISAAC, three computers, providing LifeSaving Medical Devices with the ability to act autonomously and expand access to healthcare globally.”
Increased access to imaging using physical AI
Ultrasound and X-rays are the most common and widely used diagnostic imaging systems, but almost two-thirds of the world's population is inaccessible. Enhanced imaging systems with robotic capabilities will help to expand access to care.
Nvidia and GE Healthcare have been working together for nearly 20 years, building innovative image reconstruction techniques for CT and MRI, as well as image-guided therapy and mammography.
“We are committed to providing a range of services that are important to us,” said Roland Rott, president and CEO of Imaging at GE Healthcare. “We look forward to leveraging the physical AI of autonomous imaging systems with NVIDIA technology to improve patient access and address the challenges of growing healthcare work shortages and staffing.”
ISAAC for Healthcare Closes the gap between simulation and reality
Nvidia supports other ISAAC customers for Healthcare for use cases, including simulation environments. The simulation environment allows robotic systems to safely learn skills in a virtual environment that is physically accurate for practical situations such as surgery.
Isaac for Healthcare is a physical AI platform built on three computers from Nvidia's robotics: Nvidia DGX™, Nvidia Omniverse™ and Nvidia Holoscan. This includes fine-tuned AI models for healthcare robotics that can be understood, acted and seen using enhanced vision and language processing. It also has a simulation framework that allows developers to accurately simulate medical environments, providing seamless deployment to Nvidia Holoscan, the edge AI computing platform, powering robotic decisions in real time in real-time.
Simulation options for medical sensors are often limited. Isaac for Healthcare gives developers access to physically-based digital twins in medical environments, allowing them to import custom sensors, equipment, and even anatomy to teach robots how to deal with a variety of scenarios. These virtual environments bridge the gap between simulation and real-world implementations, allowing for rapid digital prototyping.
ISAAC for Healthcare allows multi-scale simulations ranging from microscopic structures and surgical suites to complete hospital facilities. Simple policy training in simulations allows robotic systems to learn how to respond to a variety of medical scenarios in the operating room and how to best support physician decisions and patient care.
The healthcare robot ecosystem expands rapidly
ISAAC for Healthcare helps speed up the development of robotic healthcare solutions by simulating complex medical scenarios, training AI models, and optimizing robotic applications such as surgery, endoscopy, and cardiovascular intervention. Early adopters include Moonsiral, Neptune Medical and XCATH.
Isaac for Healthcare enables ecosystem partners to seamlessly integrate simulation tools, sensors, robotic systems and medical probes into domain-specific simulation environments. Among the early ecosystem partners were ANSYS, Franca, Imhujong, Kinoba and Kuka.
HealthCare's ISSAC is now available for early access.
