Before visiting a hospital for a surgical procedure, patients have many questions about what to expect and can be very nervous.
To minimize pre-surgery anxiety, Deloitte is powering Quartz Frontline AI, an AI solution for customer service powered by NVIDIA AI, to help the next generation of digital front-line teams before they even set foot in the hospital. Added an AI agent to deliver Mates to patients. .
“Frontline AI Teammate provides a fresh and innovative solution to help combat the health workforce crisis.” —Mathieu LeBreton, Digital Experience Lead, Ottawa Hospital
Built on the NVIDIA AI Enterprise software platform, these virtual teammates can have natural, human-like conversations with patients, answer a wide range of questions, and provide support prior to their pre-hospital appointment.
Deloitte collaborated with NVIDIA to add Frontline AI Teammate to the Quartz platform for use in environments such as hospitals. There, digital avatars can conduct practical conversations in multiple languages, providing end users, such as patients, with instant answers to pressing questions. .
“Avatar-based conversational AI agents present a tremendous opportunity to alleviate the productivity paradoxes that health systems face as they go digital,” said Niraj Dalmia, Partner at Deloitte Canada. “Perhaps it could be a complementary innovation that reduces administrative burden, complements and frees up medical talent, and helps solve patient experience challenges.”
Next-generation technology to empower digital humans
Digital human technology can provide life-like interactions that improve the doctor-patient experience.
Deloitte's Frontline AI Teammate is built with NVIDIA AI Enterprise and Deloitte's conversational AI framework and is designed to deliver human-machine experiences in healthcare settings. Deloitte's lifelike avatars, developed on the NVIDIA Omniverse platform, can answer complex, domain-specific questions critical to healthcare delivery.
Developers can create digital humans for healthcare industry applications using NVIDIA NIM microservices, which streamline the development of AI-powered applications and the migration of AI models into production.
NVIDIA NIM Agent Blueprints provide a customizable reference AI workflow for creating interactive AI-driven avatars ideal for telemedicine. It also includes best practices for using NVIDIA NeMo Retriever. NVIDIA NeMo Retriever is an industry-leading embed, retrieve, and rerank model. This enables rapid response based on the latest medical data.
Customizable digital humans, like James in the interactive demo developed by NVIDIA, can handle tasks such as scheduling appointments, filling out health forms, and answering questions about upcoming medical services. This increases the efficiency of healthcare services while also improving access for patients.
In addition to NIM microservices, the James interactive demo also uses NVIDIA ACE to provide natural, low-latency responses.
NVIDIA ACE is a suite of AI, graphics, and simulation technologies to bring digital humans to life. Every aspect of the digital human can be integrated into healthcare applications, from speech and translation capabilities that understand diverse accents and languages to realistic animation of facial and body movements.
Personalized experience for hospitalized patients
Patients can be overwhelmed by the amount of information available before surgery. There is usually only one pre-hospital appointment, often weeks before surgery, which can leave you with questions and heightened concerns. Additionally, the stress of a serious diagnosis prevents you from asking all the necessary questions during these brief interactions, leaving you without a comprehensive knowledge of the purpose, duration, location, and required documentation of the appointment, and the surgery may be delayed or rescheduled.
To improve patient preparation and reduce pre-surgery anxiety, Ottawa Hospital uses AI agents powered by NVIDIA and Deloitte technology to access information more consistently, accurately and continuously I'm trying to make it possible.
With Frontline AI Teammate, patients experience the following benefits:
Access your digital teammates 24/7 using your smartphone, tablet, or home computer. Pre-approved, authoritative answers to detailed questions, including information about anesthesia and the surgery itself. Post-operative consultation to answer any questions you may have regarding the recovery process. This may improve treatment adherence and health outcomes.
In user acceptance testing conducted this summer, the majority of testers noted that the responses provided were clear, relevant, and met the needs of their specific interactions.
“Frontline AI Teammate provides a fresh and innovative solution to address the health workforce crisis, reducing administrative burden and providing healthcare with the quality of care that the public deserves and expects from The Ottawa Hospital.” It potentially gives providers time back,” said Matthew LeBreton, digital experience lead at The Ottawa Hospital. “The opportunity to explore these technologies is very well timed given the plans for the new campus development, a new hospital project in Ottawa. It is essential to ensure that the information is carried out transparently.
Deloitte is working with other hospitals and healthcare organizations to implement digital agents. A patient pilot with The Ottawa Hospital is expected to begin by the end of the year.
Developers can access the Digital Human NIM Agent Blueprint to get started.
