Who We Are 

IMPACC (Impact Monitoring Dashboard for AI in Clinical Care) is a first-of-its-kind collaboration between UCSF Health and the Department of Medicine’s Division of Clinical Informatics and Digital Transformation. Our interdisciplinary group of informaticists, clinicians, data engineers, and researchers, collaborates to ensure that enterprise AI models deployed in clinical care across the health system are comprehensively evaluated and continuously monitored. We also contribute to advancing the science and methods of AI monitoring in healthcare. 

What We Do 

IMPACC monitors AI across the health system to ensure it is effective, safe, and unbiased. We develop comprehensive measurement sets and monitoring frameworks that evaluate AI’s impact across key domains critical to healthcare. Our gold-standard approach is designed around ethical and trustworthy principles, ensuring that AI serves as a beneficial tool in improving healthcare delivery and clinical outcomes. 

Our Mission 

Our mission is to build an automated AI monitoring platform that delivers continuous, reliable oversight of AI tools deployed across UCSF’s health system. We aim to improve clinical and operational performance and ensure safety, equity, and transparency. The IMPACC platform also fuels research that redefines how AI is monitored in healthcare, setting new standards for responsible oversight and accountability to ensure these tools are safe and effective for patients nationally. 

Our Vision 

We imagine a future where AI strengthens every aspect of clinical care and helps clinicians focus on what matters most and improving health outcomes for the patients we serve. To realize this future, we are building systems that continuously monitor AI tools to ensure they are safe, fair, and effective in the real world. With its unique combination of research excellence and clinical leadership, IMPACC is poised to lead the way in shaping a more trustworthy and impactful use of AI in healthcare. 

Our Commitment 

We aim to create thoughtful, rigorous approaches that ensure AI tools deliver real value and improve care, advance equity, and reduce harm. Our work is rooted in collaboration across disciplines and a deep responsibility to the UCSF community. By continuously refining our methods and learning from real-world use, we will help shape a safer, more effective future for AI in healthcare.