Ziad Obermeyer, M.D.
Acting Associate Professor of Health Policy and Management, School of Public Health, University of California Berkeley
Asking Algorithms (and Ourselves) the Right Questions
Tuesday, April 14, 2020
8 p.m. | Music Recital Hall
Algorithms are moving out of the lab and into society, where they are asked to answer tough questions: which inmates to release, which job applicants to hire, which patients to treat. These questions cause algorithms to stumble, not so much because they are hard to answer, but because they are hard to ask. Humans easily grasp the idea of finding 'the sickest patients' or 'the best applicants.' Algorithms, by contrast, are incredibly literal: they can only deal with a particular variable in a particular dataset. Research is now showing that the specific ways in which abstract ideas get translated into machine-answerable questions can distort algorithms, leading them to encode bias and error.
In his lecture, Dr. Obermeyer will discuss one example of this from his own work, where a health algorithm created large-scale racial bias for tens of millions of patients, because it used health care costs as a proxy for health care needs. He will also give two reasons to be optimistic about the future of algorithms. First, many biases are fixable, by paying close attention to seemingly small technical choices when building algorithms, as his team demonstrated by collaborating with the company that made the biased algorithm. Second, by forcing us to write down exactly what we mean – what question we are asking exactly – algorithms can hold up a mirror to our own biases, allowing us to understand and correct them.
Ziad Obermeyer, M.D. is an Acting Associate Professor of Health Policy and Management, School of Public Health, University of California Berkeley, where he does research at the intersection of machine learning, medicine, and health policy. Dr. Obermeyer also continues to practice emergency medicine at the Fort Defiance Indian Hospital, Fort Defiance, AZ, Navajo Nation.