Item-analysis of multiple choice questions: A pilot attempt to analyze formative assessment in pharmacology

Preethi J. Shenoy, Vinaykumar Sayeli, Rashmi R. Rao

Research output: Contribution to journalArticle

Abstract

The aim of the study was to assess the quality of multiple choice questions, for creating a viable question bank for future use. The study was conducted in the department of Pharmacology. The marks obtained by the second year MBBS students in the MCQ tests during Pharmacology formative examinations were analyzed. Each correct response was awarded 1 mark and each incorrect response was awarded 0, with no negative marking. Post validation of the paper was done by item analysis. Each item was analyzed for difficulty index, discrimination index and distractor effectiveness. Difficulty index of 24 (40%) items was in the acceptable range (p value 30-70%), 21 (35%) items were too easy (p value >70%) and 15 (25%) items were too difficult (p value <30%). Discrimination index of 12 (20%) items was excellent (d value >0.35), 36 (60%) items was good (d value 0.20-0.34) and 12 (20%) items were poor (d value <0.2%). A total of sixty items had 180 distractors. Amongst these, 60 (33.3%) were nonfunctional distractors, 63 (35%) were functional distractors and 57 (31.7%) had nil response i.e. not attempted by any student. On the basis of non-functional distractors, distractor effectiveness of each item was assessed. This study inferred that there is a genuine need for regular item analysis of multiple choice questions to generate a question bank with an intention to achieve uniform, reliable and valid assessment. Questions with average difficulty and high discriminating power with functional distractors should be incorporated into future tests to improve the validity and reliability of MCQ as a mode of formative assessment.

Original languageEnglish
Pages (from-to)1683-1687
Number of pages5
JournalResearch Journal of Pharmaceutical, Biological and Chemical Sciences
Volume7
Issue number2
Publication statusPublished - 01-01-2016

Fingerprint

Pharmacology
Students
Reproducibility of Results
Power (Psychology)
Discrimination (Psychology)

All Science Journal Classification (ASJC) codes

  • Biochemistry, Genetics and Molecular Biology(all)
  • Pharmacology, Toxicology and Pharmaceutics(all)

Cite this

@article{47663587a1a8476fbfeb597b44f2f697,
title = "Item-analysis of multiple choice questions: A pilot attempt to analyze formative assessment in pharmacology",
abstract = "The aim of the study was to assess the quality of multiple choice questions, for creating a viable question bank for future use. The study was conducted in the department of Pharmacology. The marks obtained by the second year MBBS students in the MCQ tests during Pharmacology formative examinations were analyzed. Each correct response was awarded 1 mark and each incorrect response was awarded 0, with no negative marking. Post validation of the paper was done by item analysis. Each item was analyzed for difficulty index, discrimination index and distractor effectiveness. Difficulty index of 24 (40{\%}) items was in the acceptable range (p value 30-70{\%}), 21 (35{\%}) items were too easy (p value >70{\%}) and 15 (25{\%}) items were too difficult (p value <30{\%}). Discrimination index of 12 (20{\%}) items was excellent (d value >0.35), 36 (60{\%}) items was good (d value 0.20-0.34) and 12 (20{\%}) items were poor (d value <0.2{\%}). A total of sixty items had 180 distractors. Amongst these, 60 (33.3{\%}) were nonfunctional distractors, 63 (35{\%}) were functional distractors and 57 (31.7{\%}) had nil response i.e. not attempted by any student. On the basis of non-functional distractors, distractor effectiveness of each item was assessed. This study inferred that there is a genuine need for regular item analysis of multiple choice questions to generate a question bank with an intention to achieve uniform, reliable and valid assessment. Questions with average difficulty and high discriminating power with functional distractors should be incorporated into future tests to improve the validity and reliability of MCQ as a mode of formative assessment.",
author = "Shenoy, {Preethi J.} and Vinaykumar Sayeli and Rao, {Rashmi R.}",
year = "2016",
month = "1",
day = "1",
language = "English",
volume = "7",
pages = "1683--1687",
journal = "Research Journal of Pharmaceutical, Biological and Chemical Sciences",
issn = "0975-8585",
publisher = "RJPBCS",
number = "2",

}

Item-analysis of multiple choice questions : A pilot attempt to analyze formative assessment in pharmacology. / Shenoy, Preethi J.; Sayeli, Vinaykumar; Rao, Rashmi R.

In: Research Journal of Pharmaceutical, Biological and Chemical Sciences, Vol. 7, No. 2, 01.01.2016, p. 1683-1687.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Item-analysis of multiple choice questions

T2 - A pilot attempt to analyze formative assessment in pharmacology

AU - Shenoy, Preethi J.

AU - Sayeli, Vinaykumar

AU - Rao, Rashmi R.

PY - 2016/1/1

Y1 - 2016/1/1

N2 - The aim of the study was to assess the quality of multiple choice questions, for creating a viable question bank for future use. The study was conducted in the department of Pharmacology. The marks obtained by the second year MBBS students in the MCQ tests during Pharmacology formative examinations were analyzed. Each correct response was awarded 1 mark and each incorrect response was awarded 0, with no negative marking. Post validation of the paper was done by item analysis. Each item was analyzed for difficulty index, discrimination index and distractor effectiveness. Difficulty index of 24 (40%) items was in the acceptable range (p value 30-70%), 21 (35%) items were too easy (p value >70%) and 15 (25%) items were too difficult (p value <30%). Discrimination index of 12 (20%) items was excellent (d value >0.35), 36 (60%) items was good (d value 0.20-0.34) and 12 (20%) items were poor (d value <0.2%). A total of sixty items had 180 distractors. Amongst these, 60 (33.3%) were nonfunctional distractors, 63 (35%) were functional distractors and 57 (31.7%) had nil response i.e. not attempted by any student. On the basis of non-functional distractors, distractor effectiveness of each item was assessed. This study inferred that there is a genuine need for regular item analysis of multiple choice questions to generate a question bank with an intention to achieve uniform, reliable and valid assessment. Questions with average difficulty and high discriminating power with functional distractors should be incorporated into future tests to improve the validity and reliability of MCQ as a mode of formative assessment.

AB - The aim of the study was to assess the quality of multiple choice questions, for creating a viable question bank for future use. The study was conducted in the department of Pharmacology. The marks obtained by the second year MBBS students in the MCQ tests during Pharmacology formative examinations were analyzed. Each correct response was awarded 1 mark and each incorrect response was awarded 0, with no negative marking. Post validation of the paper was done by item analysis. Each item was analyzed for difficulty index, discrimination index and distractor effectiveness. Difficulty index of 24 (40%) items was in the acceptable range (p value 30-70%), 21 (35%) items were too easy (p value >70%) and 15 (25%) items were too difficult (p value <30%). Discrimination index of 12 (20%) items was excellent (d value >0.35), 36 (60%) items was good (d value 0.20-0.34) and 12 (20%) items were poor (d value <0.2%). A total of sixty items had 180 distractors. Amongst these, 60 (33.3%) were nonfunctional distractors, 63 (35%) were functional distractors and 57 (31.7%) had nil response i.e. not attempted by any student. On the basis of non-functional distractors, distractor effectiveness of each item was assessed. This study inferred that there is a genuine need for regular item analysis of multiple choice questions to generate a question bank with an intention to achieve uniform, reliable and valid assessment. Questions with average difficulty and high discriminating power with functional distractors should be incorporated into future tests to improve the validity and reliability of MCQ as a mode of formative assessment.

UR - http://www.scopus.com/inward/record.url?scp=84962527469&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84962527469&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:84962527469

VL - 7

SP - 1683

EP - 1687

JO - Research Journal of Pharmaceutical, Biological and Chemical Sciences

JF - Research Journal of Pharmaceutical, Biological and Chemical Sciences

SN - 0975-8585

IS - 2

ER -