MUDI LAB

How to Assess Human Reliance on Artificial Intelligence in Hybrid Decision-Making

Tutorial @ HHAI 2023

Our tutorial proposal deals with the assessment of the level of human reliance on decision support systems in professional settings. The discourse on automation bias and algorithmic appreciation on the one hand, and algorithmic aversion on the other, calls for the development of metrics to gauge the desirability
of AI intervention for specific Human-AI Collaboration Protocols.

Presenting an overview of reliance patterns and their related biases and effects, this tutorial aims at raising the participants’ awareness on the topic of AI reliance and offering them the tools to evaluate and address detrimental reliance patterns.

Discover MUDI Lab

The tutors

Professor in Human-AI Interaction at University of Milan-Bicocca

Federico Cabitza

Federico Cabitza is an Associate Professor at the University of Milano-Bicocca (Milan, Italy) where he teaches various classes, including human-computer interaction, interaction design, information systems and decision support. He is head of the Laboratory of Uncertainty Models, Decisions and Interactions (MUDILab) in the department of Informatics at the above-mentioned university and is director of the local node of the CINI
national laboratory “Computer Science and Society.” Since 2016 he has been intensively collaborating with several hospitals, among which the IRCCS Hospital Galeazzi and Sant’Ambrogio in Milano (Italy), with which he is formally affiliated as senior researcher and where he co-founded the Medical AI laboratory. He is associate editor of the International Journal of Medical Informatics and a member of several editorial boards, including the Machine Learning and Knowledge Extraction journal, the Journal of Medical Artificial Intelligence, the Journal of Cross-disciplinary Research in Computational Law and Mondo Digitale, the official AICA journal. To date, he has published more than 150 research publications in international conference proceedings, edited books and high-impact scientific journals and is listed among the world’s most influential scientists, according to Stanford’s Top 2% Scientists list. He is the author with Prof. Luciano Floridi (former University of Oxford UK, now University of Bologna, Italy and Yale University, CT, USA) of the book “Artificial Intelligence, the use of the new machines".

WhatsApp Image 2023-04-02 at 11.06.27.jpeg

Postdoc Researcher at IRCCS
Hospital Galeazzi - Sant’Ambrogio

Andrea Campagner

Andrea Campagner is a member of the Laboratory of Uncertainty Models
Decision and Interactions (MUDILab) at University of Milan-Bicocca, where he teaches several classes (including Decision Support Systems and Uncertain and Complex Systems), and Researcher at the IRCCS Ospedale Galeazzi - Sant’Ambrogio. He is a member of the editorial board at International Journal of Medical Informatics, and conference chair at CD-MAKE 2023. He has been a member of the program committee at several international conferences (including ECML 2022, UAI 2022 and 2023), organized workshops and special sessions (on Weakly Supervised Learning at IPMU 2022, and on Multi-Perspectivist Data and Learning at CD-MAKE 2023) and acted as guest editor for the Special Issue on Weakly and Cautious Learning in the Array journal. His main research interests regard the theory and practice of machine learning and uncertainty representation and management, as well as their interactions. He is also interested in human-AI interaction and medical informatics, and more generally in the impact and application of artificial intelligence and machine learning in decision making.
To date, he has authored more than 50 publications in international conference proceedings and high-impact scientific journals.

PhD Student at University of Milan-Bicocca

Chiara Natali

Chiara Natali is a first-year PhD student in Computer Science at the University of Milano-Bicocca (Milan, Italy), with a background in Philosophy (MA) and Political Science (BSc). She is a member of the Laboratory of Uncertainty Models Decision and Interactions (MUDILab); previously, she worked with the responsible design start-up ReD OPEN, researching the topics of Ethical AI and risk impact assessment of AI in the field of justice. She aims to contribute to the Hybrid Intelligence community with her studies on Human-AI collaboration and interaction protocols, as well as AI-augmented human creativity. She is a TEDx speaker, with the talk “The power of creating imperfect art”.
In her doctoral career, she has presented her work in international conferences, workshops and summer schools such as HHAI 2022 (Amsterdam, the Netherlands), EURA Summer School on the Regulation of Robotics and AI in Europe (Pisa, Italy), EPFL’s To Trust or Not To Trust: When Should AI Be Allowed to Make Decisions (Lausanne, Switzerland), AIxIA - 21st International Conference of the Italian Association for Artificial Intelligence (Udine, Italy) and ELLIS - CMU Joint Workshop on Human-Centered AI (Alicante, Spain)