Artificial intelligence (AI) is increasingly influencing healthcare, but its integration is far from seamless. In her PhD dissertation, "Broken Glass in the Clinic: Tracing the Performativity of Artificial Intelligence in Clinical Practice," Chiara Carboni (Erasmus School of Health Policy & Management) examines how AI reshapes clinical settings, raising both opportunities and profound challenges.
Artificial intelligence (AI) is playing an increasingly significant role in healthcare, yet its integration is far from seamless. In her PhD dissertation, "Broken Glass in the Clinic: Tracing the Performativity of Artificial Intelligence in Clinical Practice," Chiara Carboni (Erasmus School of Health Policy & Management) explores how AI reshapes clinical settings, presenting both opportunities and profound challenges. 'My research aims to strike a balance between leveraging the benefits of AI integration and addressing the social and ethical implications,' she says.
AI in healthcare is a widely discussed topic. Media often highlight breakthroughs, such as more precise diagnoses enabled by AI. But can we truly be optimistic about AI's role, and what challenges does it pose? Carboni's research delves into case studies in pathology, intensive care, and acute psychiatry, shedding light on how AI systems influence workflows, professional roles, and ethical practices. She critiques the assumption that AI simplifies or reduces labor in healthcare.
Reliability and Decision-Making
In pathology, Carboni examines the transition from traditional microscope slides to digital imaging, intended to prepare for AI-driven diagnostics. However, many pathologists find digital images less reliable and harder to interpret, leading to uncertainty in their work. In intensive care, AI dashboards are designed to help nurses prioritize critical tasks by analyzing real-time data. 'While these AI-driven systems can indeed enhance efficiency, they risk undermining the authority and decision-making autonomy of healthcare professionals. Nurses may feel that their knowledge and experience are being replaced by automated systems,' she explains.
'My research aims to strike a balance between leveraging the benefits of AI integration and addressing the social and ethical implications'
Chiara Carboni
Phd Candidate Health Care Governance (HCG)
AI transforms Healthcare
In psychiatry, predictive algorithms are used to assess the risk of violent behavior. Yet, caregivers often view these tools skeptically, as they seem to oversimplify a complex and ethically sensitive phenomenon like violence. Carboni argues that AI doesn't merely add new tools to healthcare—it transforms how care is organized. Tasks are frequently restructured to accommodate AI systems, creating additional work for professionals rather than reducing it. Such changes can erode professional autonomy and introduce ethical dilemmas.
Beyond Efficiency
Carboni emphasizes the importance of a thoughtful approach to AI implementation that prioritizes improving care over sheer efficiency. To collaborate effectively with AI, healthcare workers need time to question and reflect on its outputs. She argues that AI should support healthcare workers rather than replace their expertise. Furthermore, the labor required to generate data for AI—often shouldered by nurses, secretaries, and technicians—must be recognized and valued within organizations. Carboni: 'My primary goal is to provide a nuanced understanding of how clinical practice is changing, not just due to AI itself but also to the expectations surrounding it.'
- PhD student
- More information
Chiara Carboni was interviewed by Medical Delta in September. Read the full interview here.
- Related content
