The Business of Health with Chip Kahn: Episode 13, AI Series: Regulating AI in Medicine

The rapid integration of artificial intelligence (AI) into daily medical practice has heralded a new era in healthcare, promising transformative advancements in diagnostics, treatment, and patient care. However, this technological surge also presents a complex tapestry of ethical, legal, and regulatory challenges that demand immediate and thoughtful consideration. On July 21, 2026, the KFF podcast series "The Business of Health with Chip Kahn" addressed these critical issues in its 13th episode, part of an ongoing AI series, featuring Dr. Michelle Mello of Stanford University. The discussion, titled "Regulating AI in Medicine," delved into the pressing questions surrounding governance, accountability, and the ethical deployment of AI in clinical settings.

Hosted by Charles N. Kahn III, a distinguished senior visiting fellow at KFF, the American Enterprise Institute, and the University of Southern California’s Schaeffer Center for Health Policy & Economics, the episode provided a crucial platform for exploring the uncharted territories of AI regulation. Kahn, also co-chair of the international Future of Health collaborative, brought his extensive expertise in health policy to guide a conversation that underscored the urgency of establishing clear guidelines as AI systems become increasingly sophisticated and pervasive.

The Rapid Ascent of AI in Healthcare

Artificial intelligence is not merely an emergent technology in healthcare; it is rapidly becoming an indispensable tool across a myriad of applications. From enhancing diagnostic accuracy in radiology and pathology to personalizing treatment plans for oncology patients and accelerating drug discovery, AI’s potential to revolutionize medicine is immense. The global AI in healthcare market, valued at approximately $15 billion in 2023, is projected to surge to over $200 billion by 2032, reflecting an astounding compound annual growth rate (CAGR) of nearly 30%. This exponential growth is driven by several factors: the proliferation of big data in healthcare (electronic health records, genomic data, imaging), advancements in machine learning algorithms, and the increasing demand for more efficient and precise healthcare solutions.

AI algorithms are being deployed to predict disease outbreaks, manage hospital operations, assist in robotic surgeries, and even power virtual health assistants. For instance, AI-powered diagnostic tools are showing capabilities to detect subtle indicators of diseases like cancer or diabetic retinopathy earlier and with greater precision than human clinicians alone, potentially leading to improved patient outcomes and reduced healthcare costs. In drug discovery, AI can analyze vast chemical libraries and biological data to identify potential drug candidates and predict their efficacy and toxicity, significantly shortening development timelines and costs. These applications, while promising, underscore the profound impact AI will have on every facet of healthcare delivery and, consequently, the critical need for robust oversight.

Navigating the Ethical Minefield

The enthusiasm surrounding AI’s capabilities is tempered by a growing recognition of the profound ethical dilemmas it introduces. Dr. Michelle Mello, a leading authority in health law, ethics, and policy, articulated these concerns during her discussion with Chip Kahn. As a Professor of Law and Health Policy at Stanford University and co-director of the Healthcare Ethical Assessment Lab for Artificial Intelligence (HEAL-AI), Dr. Mello is at the forefront of examining these complex issues. Her work, which spans nearly 300 articles, frequently addresses topics such as medical liability, patient safety, and the ethical implications of biomedical research.

One of the foremost ethical challenges is algorithmic bias. AI systems are trained on vast datasets, and if these data reflect existing societal biases—whether related to race, gender, socioeconomic status, or geographical location—the AI can perpetuate and even amplify these biases, leading to inequitable health outcomes. For example, an AI diagnostic tool trained predominantly on data from one demographic group might perform poorly or provide inaccurate diagnoses for patients from other groups. This raises critical questions about health equity and the potential for AI to exacerbate disparities rather than mitigate them.

Transparency and explainability also pose significant ethical hurdles. Many advanced AI models, particularly deep learning networks, operate as "black boxes," meaning their decision-making processes are opaque and difficult for humans to understand. In a clinical context, where patient lives are at stake, the inability to explain why an AI made a particular recommendation can erode trust, complicate clinical decision-making, and hinder medical liability assessments. Patients and clinicians alike need to understand the basis of AI-driven insights to make informed choices and ensure accountability.

Furthermore, issues of data privacy and security are paramount. AI systems require access to massive amounts of sensitive patient data. Ensuring the robust protection of this information from breaches, misuse, and unauthorized access is a fundamental ethical and legal imperative. The potential for AI to infer highly personal information from seemingly innocuous data also raises new privacy concerns that traditional regulations may not adequately address.

The Regulatory Vacuum and Emerging Frameworks

The core of the discussion between Kahn and Mello centered on the "rules of the road" for AI in medicine, highlighting the stark reality that these rules are still largely unwritten. The pace of technological innovation in AI far outstrips the rate at which regulatory frameworks can be developed and implemented. This creates a regulatory vacuum, where cutting-edge tools are being deployed without comprehensive guidelines for their safety, efficacy, and ethical use.

In the United States, the Food and Drug Administration (FDA) has begun to address AI in medical devices, primarily through existing regulatory pathways designed for software as a medical device (SaMD). The FDA has issued guidance documents and approved a growing number of AI-powered devices, particularly in imaging and diagnostics. However, these efforts often focus on the performance and safety of specific products rather than the broader systemic and ethical implications of AI’s integration into healthcare workflows. There is an ongoing debate about how to regulate "adaptive AI" systems that continuously learn and evolve after deployment, which challenges traditional regulatory models based on fixed product specifications.

Globally, other regulatory bodies are also grappling with these challenges. The European Union, for instance, is pioneering comprehensive AI regulation with its proposed AI Act, which classifies AI systems based on their risk level, imposing stringent requirements on "high-risk" applications, including those in healthcare. While the EU AI Act is still under negotiation, it represents a significant step towards a holistic regulatory approach that goes beyond product-specific approvals to address broader ethical and societal concerns. Such initiatives highlight a global recognition that a patchwork of existing laws is insufficient to govern the complex landscape of AI in medicine.

Accountability in the Age of Algorithms

A central question posed by Kahn, and addressed by Dr. Mello, concerned accountability: "who ensures the technology gets it right – and who answers when it doesn’t?" This query strikes at the heart of medical liability and professional responsibility in an AI-augmented world. Traditionally, medical errors lead to liability for human clinicians, hospitals, or device manufacturers. However, when an AI system contributes to an adverse event, determining fault becomes significantly more complicated.

Is the AI developer responsible? The healthcare provider who used the AI? The hospital that implemented it? Or the data scientists who curated the training data? Dr. Mello’s research in medical liability is particularly relevant here, as she explores how existing legal frameworks might adapt to these new scenarios. The "black box" nature of some AI systems further complicates this, making it difficult to trace the causal chain of an error. This uncertainty poses a significant challenge for legal systems designed for human agency.

Experts suggest that a multi-layered approach to accountability might be necessary, involving shared responsibility among developers, deployers, and users. This would require clear standards for AI validation, ongoing monitoring, transparency in algorithm design, and robust frameworks for incident reporting and analysis. Without clear lines of accountability, there is a risk of either stifling innovation due to fear of liability or, conversely, undermining patient safety by allowing unvetted AI tools to operate without adequate oversight. The discussion emphasized that clarity on accountability is not just a legal technicality but a foundational element for building public and professional trust in AI-powered healthcare.

Stanford’s HEAL-AI Lab: A Proactive Approach

Dr. Mello’s work at Stanford University’s Healthcare Ethical Assessment Lab for Artificial Intelligence (HEAL-AI) offers a tangible example of a proactive approach to these challenges. As co-director, she leads efforts to conduct ethical assessments of AI tools proposed for deployment at Stanford Health Care facilities. This initiative is crucial because it moves beyond theoretical discussions to practical, real-world evaluation.

HEAL-AI’s methodology likely involves a rigorous review process that considers not only the technical performance of AI tools but also their potential impact on patient equity, privacy, autonomy, and the clinical workflow. By assessing AI tools before their widespread implementation, HEAL-AI can identify and mitigate risks related to bias, transparency, and accountability. This kind of interdisciplinary lab, combining expertise from law, medicine, ethics, and computer science, serves as a vital model for other healthcare institutions globally. It embodies the principle that ethical considerations should be baked into the development and deployment pipeline of AI, rather than being an afterthought. Such labs are instrumental in translating abstract ethical principles into actionable guidelines for clinical practice.

The Role of Experts: Chip Kahn and Dr. Michelle Mello

The synergy between Chip Kahn’s extensive background in health policy and Dr. Michelle Mello’s deep expertise in health law and ethics provided a comprehensive and authoritative perspective on these intricate issues. Kahn’s role as a senior visiting fellow at prominent institutions and his leadership in the Future of Health collaborative position him to understand the broader economic, political, and systemic forces shaping healthcare. His ability to connect the dots between healthcare business, policy, and patient impact is central to the "Business of Health" podcast’s mission.

Dr. Mello, with her dual professorships at Stanford Law School and School of Medicine, embodies the interdisciplinary approach necessary to tackle AI’s complexities. Her Ph.D. in Health Policy and Administration further strengthens her capacity to analyze the socio-economic and organizational implications of AI, alongside its legal and ethical dimensions. Her focus on empirical research ensures that her insights are grounded in real-world data and observations, providing a pragmatic view of how policies and ethical frameworks can be effectively applied. Together, their dialogue provided listeners with a nuanced understanding of the multifaceted challenges and opportunities presented by AI in medicine.

The Broader "Business of Health" Context

This episode is a critical installment in "The Business of Health with Chip Kahn" podcast series, which consistently offers insightful conversations on the intricate interplay between the healthcare business, policy, and patient care. The AI series, in particular, illuminates how AI is fundamentally reshaping healthcare delivery, bringing together guests who are at the forefront of deploying this technology, managing its consequences, and designing policy around it. By dedicating a significant portion of the series to AI, the podcast underscores the technology’s transformative power and the imperative for informed dialogue among stakeholders. The discussions aim to equip policymakers, industry leaders, healthcare professionals, and patients with a better understanding of the profound implications of AI for the future of health.

Looking Ahead: The Future of AI Governance in Medicine

As AI continues its rapid advancement, the questions of who makes the rules, who ensures accuracy, and who bears responsibility when things go wrong will only grow more urgent. The conversation between Chip Kahn and Dr. Michelle Mello highlighted that the path forward requires a collaborative and adaptive approach. This includes fostering greater collaboration between AI developers, healthcare providers, ethicists, legal experts, and regulatory bodies. It necessitates investment in research to better understand AI’s impact on diverse populations, and the development of robust, transparent evaluation methodologies.

The future of AI in medicine is undeniably bright with potential, but its ethical and equitable deployment hinges on the establishment of thoughtful, dynamic regulatory frameworks. Without these "rules of the road," the risks of algorithmic bias, patient harm, and eroded trust could overshadow the immense benefits AI promises. The ongoing dialogue on platforms like "The Business of Health with Chip Kahn" is therefore not merely academic; it is essential for shaping a future where AI serves as a powerful, responsible tool for advancing global health and well-being. The insights shared in this episode serve as a clarion call for continued vigilance, proactive policy development, and an unwavering commitment to ethical principles as AI continues its integration into the fabric of everyday medicine.