
Healthcare AI is moving faster than many health systems can govern it.In this episode of Straight Out of Health IT, David Hilderbrand, Chief Commercial Officer at Ferrum Health, joins Christopher Kunney to discuss the rapid rise of clinical AI, medical imaging AI consolidation, and the growing need for enterprise-level governance. He explains why health systems are no longer just asking which AI tools to buy, but how to monitor, manage, and understand the tools already running across their organizations. As AI enters through devices, platforms, service lines, and vendor relationships, CIOs and clinical leaders are facing a new kind of operational complexity. The conversation explores why effective AI oversight has become essential as adoption accelerates across healthcare.David breaks down the difference between AI committees, analytics, telemetry, and true governance. He explains that governance is not simply about knowing whether an algorithm is turned on, but about understanding how it behaves in clinical care and how it performs across different patient populations. Without that level of visibility, health systems risk overlooking issues such as bias, model drift, inconsistent performance, and patient impact. He argues that meaningful governance is critical to ensuring AI delivers safe, reliable, and measurable clinical value.David also shares how Ferrum Health approaches clinical AI through platforming, observability, and neutral model monitoring. Rather than recommending which AI tools organizations should adopt, Ferrum helps health systems gain visibility into their entire AI portfolio so they can make informed decisions about expanding, replacing, or retiring algorithms. The discussion also covers measuring ROI, recognizing the costs of underperforming AI models, and the importance of early disease detection. Hilderbrand concludes by explaining why AI governance should remain independent from vendor bias to support better long-term clinical and operational outcomes.Tune in to hear why clinical AI governance is becoming essential infrastructure for health systems, and why the future of healthcare AI depends on visibility, accountability, and trust.Key TakeawaysClinical AI is expanding quickly, but many health systems lack the tools to understand what is actually running across their environments. Vendor sprawl is creating new operational, financial, and clinical risks as AI tools enter through devices, platforms, and service lines. True AI governance goes beyond telemetry and analytics; it requires visibility into how algorithms interact with patients and clinical workflows. Health systems need unbiased observability to determine whether clinical AI tools are performing as promised. AI governance can help organizations reduce the cost of failed algorithms and improve the value of their AI investments. Early detection through clinical AI can improve patient outcomes while also reducing downstream care costs. Governance must remain separate from vendor bias so health systems can make clear decisions about which tools to keep, expand, replace, or remove. The next phase of clinical AI will require stronger infrastructure, especially as agentic AI and cloud-based workflow solutions grow.ResourcesConnect with David Hilderbrand on LinkedIn.Follow Ferrum Health on LinkedIn and visit their website.
Podzilla Summary coming soon
Sign up to get notified when the full AI-powered summary is ready.
Free forever for up to 3 podcasts. No credit card required.
Free AI-powered recaps of Straight Outta Health IT and your other favorite podcasts, delivered to your inbox.
Free forever for up to 3 podcasts. No credit card required.