Title: Evaluation of Multiple Choice Questions by Item Analysis in a Medical College- A Pilot Study
Authors: Dr Janice Jaison, Dr Rajendra Zope, Dr Sneha R Joshi
DOI: https://dx.doi.org/10.18535/jmscr/v5i8.160
Abstract
Introduction: Assessment is an integral part of any learning and training. Multiple choice questions (MCQs) are a widely used tool in assessment protocols. To increase the validity of MCQs standard prevalidation and post validation protocols are recommended. Item Analysis is a post validation procedure.
Aims and Objectives: Difficulty index, Discrimination index and Distracter effectiveness are the parameters used to evaluate the standard of MCQs
Materials and Methods: This study was conducted in the Department of Pathology ata Medical College. This is a retrospective study. The Term end examination MCQ paper after the 1st semester was assessed. Based on the answers marked by the students the Difficulty index, Discrimination index and Distracter effectiveness were calculated.
Results: In the present study, according to the Difficulty index criteria 50% of the MCQs were acceptable, of which 15% were ideal. On the basis of Discrimination index, 60% were good discriminator and 35% of the MCQs were excellent with a DI greater than 0.35%. In 45% MCQs the distracters were effective. Only 7 out of 20 MCQs satisfied all the criteria for an ideal MCQ.
Conclusion: This exercise was an eye opener revealing the quality of the MCQs and it will also help while formulating MCQs for future exams.
Keywords: MCQ, item analysis.
