Nvidia’s new Medical Physics Simulation framework treats healthcare robots as physical AI systems that need embodied experience to learn, not just code.
Physical AI is the term Nvidia and much of the robotics industry now use to describe machines that have to learn how the world behaves through contact, force, and consequence, rather than through text or images alone.
A language model learns from text. A physical AI system learns from what happens when a catheter meets a vessel wall, or when a robotic arm applies too much pressure to soft tissue. That kind of learning normally requires either a physical body operating in the physical world, or a simulation detailed enough to stand in for one.
For healthcare robotics, physical bodies operating in real procedures are scarce, tightly regulated, and slow to generate the range of scenarios a robot actually needs to see. Medical Physics Simulation is Nvidia’s attempt to manufacture that embodied experience computationally.
Announced as an open-source addition to the company’s Isaac for Healthcare platform, the framework generates the physical interactions a surgical or diagnostic robot would otherwise need years of clinical exposure to encounter: a guidewire catching on a calcified vessel wall, a kidney stone lodged at an unusual angle, or the soft-tissue response that only shows up in a small fraction of procedures.
None of these edge cases arrive on schedule in an operating theatre. Simulation lets developers generate them on demand.
Building physical intuition before a scalpel gets involved
The framework combines two ways of modelling how devices behave inside a body.
Classical physics simulation handles the mechanical rules that are already well understood, how a catheter bends, how much resistance a vessel wall applies, how contact forces shift as an instrument moves through tissue. Generative AI handles the part that’s harder to hand-code: visual scene dynamics learned from procedural data, delivered through a component Nvidia calls Cosmos-H Dreams.
That combination is the physical AI proposition in miniature. Classical simulation gives a robot policy the physics it needs to obey. Generative simulation gives it the range of visual and anatomical variation it needs to generalise. Put together, and run at scale on GPUs using Nvidia’s Warp and Newton libraries, the framework can execute large numbers of parallel training environments instead of one scene at a time.
Nvidia states that a benchmark running 8,192 parallel environments cut training time from over five hours to under two minutes. However, that demonstrates throughput – not clinical reliability – and it says nothing about how a policy trained this way performs against incomplete imaging, delayed sensor readings, and even anatomy that falls outside anything the simulation modelled.
A language model that underperforms on an edge case produces a bad answer, but a physical AI system that underperforms on an edge case is operating inside a patient. The parallel-simulation approach is a real advance in how fast developers can explore failure modes. Whether those simulated failure modes match what actually goes wrong in a surgical suite is a separate question.
Where the embodiment approach is being tested
The organisations Nvidia names as early adopters are applying the physical AI approach at different depths, and the list is worth reading with that in mind rather than treating it as a uniform roster of deployments.
CMR Surgical and Cambridge Consultants, the Capgemini-owned engineering firm, have gone furthest on the data side. CMR has contributed close to 500 hours of anonymised clinical data from its Versius Surgical Robotic System to the Open-H Embodiment dataset, spanning cholecystectomy, prostatectomy, hernia repair and hysterectomy procedures, and the pair are using Cosmos-H Dreams to model soft-tissue interaction physics and produce patient-specific simulations.
“Open-source models allow us to build on shared knowledge, accelerating responsible innovation and, ultimately, gives us the potential to deliver more consistent care and better outcomes for patients worldwide,” said Chris Fryer, CTO at CMR Surgical.
Johnson & Johnson MedTech is using the framework alongside a Cosmos-based foundation model to build a digital twin of its endoluminal MONARCH platform, focused on kidney-stone scenarios in urology.
XCath is applying it to endovascular autonomy policy training, teaching a system the physical behaviour of navigating blood vessels without a human hand on the controls. Inner Logic is generating synthetic data to validate device mechanics, and says it intends to produce in silico evidence to support regulatory submissions, though no submission built on that evidence has been confirmed publicly.
Medtronic Structural Heart sits earliest in the group, exploring simulated X-ray sensing for catheter navigation research.
Each of these is a training exercise or dataset contribution. None is a deployed system operating on a patient with policies learned this way, and Nvidia doesn’t claim otherwise.
The open-source case for physical AI systems
Healthcare robotics carries a governance requirement most physical AI applications, including industrial and warehouse robots, don’t face to the same degree: regulators and clinical review boards need to see how a system arrived at its behaviour, not just confirm that the behaviour looked acceptable in testing.
An open-source framework lets developers inspect the physics assumptions inside the simulation, reproduce results across different anatomies, and build an evidence trail suited to a submission before the FDA or an equivalent body.
That’s a stronger argument for openness in physical AI than it is in most software categories, where a closed vendor pipeline hides the assumptions a team would otherwise need to defend to a regulator. It doesn’t settle the validation question on its own.
Open code lets outside reviewers check the model’s logic, but it doesn’t confirm the model’s physical behaviour matches what happens in a body, and that confirmation still has to come from testing that none of these companies has published yet.
Nvidia has built infrastructure that could shorten the pre-hardware phase of physical AI development for surgical and diagnostic robots, and running training at this scale in parallel is a departure from rebuilding a custom simulation scene for every workflow.
You can hear more about this topic at the Physical AI Expo.
See also: Bristol Myers Squibb buys Nvidia AI system for drug discovery
Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and London. The comprehensive event is part of TechEx and is co-located with other leading technology events including the Cyber Security & Cloud Expo. Click here for more information.
AI News is powered by TechForge Media. Explore other upcoming enterprise technology events and webinars here.