Validation of a mini focus group interview for postgraduate year training program selection

A BSTRACT Objectives: The postgraduate year (PGY) general medical training program represents a major reform in Taiwan’s medical education. As PGY training expanded nationwide, hospitals were required to conduct entrance examinations; however, standardized selection tools remain limited. Since 2011, Kaohsiung Medical University Hospital (KMUH) has implemented a mini focus group interview for PGY recruitment. This study evaluates the reliability and validity of this interview method. Materials and Methods: A total of 408 applicants who participated in the KMUH PGY entrance examination during 2021–2022 were analyzed. Admission decisions weighted document review and interview performance equally (50% each). The interview consisted of 12 parallel structured assessment stations assessing three domains. Reliability was examined using Cronbach’s α and intraclass correlation coefficients (ICCs). Validity was assessed through rating consistency analysis and predictive validity between interview scores and case-based discussion (CbD) performance using Pearson’s correlation ( r ). Station equivalence was additionally evaluated using score distribution characteristics and the Kruskal–Wallis test.