Who We Are

A first-of-its-kind collaboration between UCSF Health and the Department of Medicine’s Division of Clinical Informatics and Digital Transformation.

Our interdisciplinary group of informaticists, clinicians, data engineers, and researchers, collaborates to ensure that enterprise AI models deployed in clinical care across the health system are comprehensively evaluated and continuously monitored. We also contribute to advancing the science and methods of AI monitoring in healthcare. 

Meet the team

What We Do 

Monitor AI across the health system to ensure it is effective, safe, and unbiased.

We develop comprehensive measurement sets and monitoring frameworks that evaluate AI’s impact across key domains critical to healthcare. Our gold-standard approach is designed around ethical and trustworthy principles, ensuring that AI serves as a beneficial tool in improving healthcare delivery and clinical outcomes.

Our Mission  

Build an automated AI monitoring platform that delivers continuous, reliable oversight of AI tools deployed across UCSF’s health system.

We aim to improve clinical and operational performance and ensure safety, equity, and transparency. The IMPACC platform also fuels research that redefines how AI is monitored in healthcare, setting new standards for responsible oversight and accountability to ensure these tools are safe and effective for patients nationally. 

UCSF Study Identifies Varied Benefits from AI Scribes with Implications for Return on Investment

Findings show AI scribes reduce documentation burden, but benefits vary by physician baseline efficiency. Read more here.

UCSF Study Finds AI Scribes Associated with Increased Physician Productivity and Revenue

Research published in JAMA Network Open shows 5.8% RVU increase among AI scribe adopters, with no rise in claim denials. Read more here.

More IMPACC News

Read more here