Standardization and validation of objective structured practical examination in pharmacology: Our experience and lessons learned

Preethi Shenoy, Priyanka Kamath, Vinaykumar Sayeli, Sunil Pai

Research output: Contribution to journalReview article

1 Citation (Scopus)

Abstract

OBJECTIVES: The present study is an attempt to standardize and establish validity and reliability of objective structured practical examination (OSPE) as a tool of assessment in pharmacology. METHODS: The individual stations were standardized by establishing the blueprint of assessment, checklists for individual OSPE stations, and a review and revision of existing OSPE stations through intensive focus group discussions. Face and content validity was established by subject nonexperts and experts, respectively. Internal construct reliability was assessed using Cronbach's alpha. The scores obtained by the students during their formative sessional examinations were analyzed to calculate Cronbach's alpha, a measure of internal construct reliability and Pearson's coefficient of correlation was used to analyze test-retest reliability and interexaminer reliability. Student and faculty feedback were taken using an open-ended questionnaire. RESULTS: The Pearson's coefficient of correlation for inter-rater reliability was 0.985, P = 0.0001. The Pearson's coefficient of correlation for test-retest reliability was 0.967, P = 0.0001. Cronbach's alpha values for first, second, and third sessional examinations were 0.825, 0.724, and 0.798, respectively. CONCLUSION: The faculty and student feedback received was constructive and enabled a systematic review of the existing method and also served as a means to revise the existing curricula.

Original languageEnglish
Pages (from-to)270-274
Number of pages5
JournalIndian Journal of Pharmacology
Volume49
Issue number4
DOIs
Publication statusPublished - 01-07-2017

Fingerprint

Reproducibility of Results
Pharmacology
Students
Focus Groups
Checklist
Curriculum

All Science Journal Classification (ASJC) codes

  • Pharmacology
  • Pharmacology (medical)

Cite this

@article{b6b69e5c780049f4bb2edf00764cfdcb,
title = "Standardization and validation of objective structured practical examination in pharmacology: Our experience and lessons learned",
abstract = "OBJECTIVES: The present study is an attempt to standardize and establish validity and reliability of objective structured practical examination (OSPE) as a tool of assessment in pharmacology. METHODS: The individual stations were standardized by establishing the blueprint of assessment, checklists for individual OSPE stations, and a review and revision of existing OSPE stations through intensive focus group discussions. Face and content validity was established by subject nonexperts and experts, respectively. Internal construct reliability was assessed using Cronbach's alpha. The scores obtained by the students during their formative sessional examinations were analyzed to calculate Cronbach's alpha, a measure of internal construct reliability and Pearson's coefficient of correlation was used to analyze test-retest reliability and interexaminer reliability. Student and faculty feedback were taken using an open-ended questionnaire. RESULTS: The Pearson's coefficient of correlation for inter-rater reliability was 0.985, P = 0.0001. The Pearson's coefficient of correlation for test-retest reliability was 0.967, P = 0.0001. Cronbach's alpha values for first, second, and third sessional examinations were 0.825, 0.724, and 0.798, respectively. CONCLUSION: The faculty and student feedback received was constructive and enabled a systematic review of the existing method and also served as a means to revise the existing curricula.",
author = "Preethi Shenoy and Priyanka Kamath and Vinaykumar Sayeli and Sunil Pai",
year = "2017",
month = "7",
day = "1",
doi = "10.4103/ijp.IJP_519_16",
language = "English",
volume = "49",
pages = "270--274",
journal = "Indian Journal of Pharmacology",
issn = "0253-7613",
publisher = "Medknow Publications and Media Pvt. Ltd",
number = "4",

}

Standardization and validation of objective structured practical examination in pharmacology : Our experience and lessons learned. / Shenoy, Preethi; Kamath, Priyanka; Sayeli, Vinaykumar; Pai, Sunil.

In: Indian Journal of Pharmacology, Vol. 49, No. 4, 01.07.2017, p. 270-274.

Research output: Contribution to journalReview article

TY - JOUR

T1 - Standardization and validation of objective structured practical examination in pharmacology

T2 - Our experience and lessons learned

AU - Shenoy, Preethi

AU - Kamath, Priyanka

AU - Sayeli, Vinaykumar

AU - Pai, Sunil

PY - 2017/7/1

Y1 - 2017/7/1

N2 - OBJECTIVES: The present study is an attempt to standardize and establish validity and reliability of objective structured practical examination (OSPE) as a tool of assessment in pharmacology. METHODS: The individual stations were standardized by establishing the blueprint of assessment, checklists for individual OSPE stations, and a review and revision of existing OSPE stations through intensive focus group discussions. Face and content validity was established by subject nonexperts and experts, respectively. Internal construct reliability was assessed using Cronbach's alpha. The scores obtained by the students during their formative sessional examinations were analyzed to calculate Cronbach's alpha, a measure of internal construct reliability and Pearson's coefficient of correlation was used to analyze test-retest reliability and interexaminer reliability. Student and faculty feedback were taken using an open-ended questionnaire. RESULTS: The Pearson's coefficient of correlation for inter-rater reliability was 0.985, P = 0.0001. The Pearson's coefficient of correlation for test-retest reliability was 0.967, P = 0.0001. Cronbach's alpha values for first, second, and third sessional examinations were 0.825, 0.724, and 0.798, respectively. CONCLUSION: The faculty and student feedback received was constructive and enabled a systematic review of the existing method and also served as a means to revise the existing curricula.

AB - OBJECTIVES: The present study is an attempt to standardize and establish validity and reliability of objective structured practical examination (OSPE) as a tool of assessment in pharmacology. METHODS: The individual stations were standardized by establishing the blueprint of assessment, checklists for individual OSPE stations, and a review and revision of existing OSPE stations through intensive focus group discussions. Face and content validity was established by subject nonexperts and experts, respectively. Internal construct reliability was assessed using Cronbach's alpha. The scores obtained by the students during their formative sessional examinations were analyzed to calculate Cronbach's alpha, a measure of internal construct reliability and Pearson's coefficient of correlation was used to analyze test-retest reliability and interexaminer reliability. Student and faculty feedback were taken using an open-ended questionnaire. RESULTS: The Pearson's coefficient of correlation for inter-rater reliability was 0.985, P = 0.0001. The Pearson's coefficient of correlation for test-retest reliability was 0.967, P = 0.0001. Cronbach's alpha values for first, second, and third sessional examinations were 0.825, 0.724, and 0.798, respectively. CONCLUSION: The faculty and student feedback received was constructive and enabled a systematic review of the existing method and also served as a means to revise the existing curricula.

UR - http://www.scopus.com/inward/record.url?scp=85041315355&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85041315355&partnerID=8YFLogxK

U2 - 10.4103/ijp.IJP_519_16

DO - 10.4103/ijp.IJP_519_16

M3 - Review article

AN - SCOPUS:85041315355

VL - 49

SP - 270

EP - 274

JO - Indian Journal of Pharmacology

JF - Indian Journal of Pharmacology

SN - 0253-7613

IS - 4

ER -