Bioengineering
Development and Clinical Validation of an Automated LLM Judge for Evaluating Perioperative Patient Questions
By Bernardo Gabriele Collaço, Nadia G. Wood, Yunguo Yu and 7 others.
Abstract
Background
Large language models (LLMs) are increasingly used in patient-facing clinical applications, creating a need for scalable methods to evaluate the accuracy, safety, and appropriateness of their responses. Although physician review remains the reference standard, it is resource-intensive and difficult to scale.
Objective
To develop and clinically validate an LLM-as-a-judge framework for evaluating responses to patients’ periprocedural questions.
