Research design and statistical methods in Indian medical journals: A retrospective survey

Shabbeer Hassan, Rajashree Yellur, Pooventhan Subramani, Poornima Adiga, Manoj Gokhale, Manasa S. Iyer, Shreemathi S. Mayya

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Good quality medical research generally requires not only an expertise in the chosen medical field of interest but also a sound knowledge of statistical methodology. The number of medical research articles which have been published in Indian medical journals has increased quite substantially in the past decade. The aim of this study was to collate all evidence on study design quality and statistical analyses used in selected leading Indian medical journals. Ten (10) leading Indian medical journals were selected based on impact factors and all original research articles published in 2003 (N = 588) and 2013 (N = 774) were categorized and reviewed. A validated checklist on study design, statistical analyses, results presentation, and interpretation was used for review and evaluation of the articles. Main outcomes considered in the present study were - study design types and their frequencies, error/defects proportion in study design, statistical analyses, and implementation of CONSORT checklist in RCT (randomized clinical trials). From 2003 to 2013: The proportion of erroneous statistical analyses did not decrease (χ2=0.592, φ =0.027, p=0.4418), 25% (80/320) in 2003 compared to 22.6% (111/490) in 2013. Compared with 2003, significant improvement was seen in 2013; the proportion of papers using statistical tests increased significantly (χ2=26.96, φ =0.16, p< 0.0001) from 42.5% (250/588) to 56.7%(439/774). The overall proportion of errors in study design decreased significantly (χ2=16.783, Ö=0.12 p <0.0001), 41.3%(243/588) compared to 30.6%(237/774). In 2013, randomized clinical trials designs has remained very low (7.3%, 43/588) with majority showing some errors (41 papers, 95.3%). Majority of the published studies were retrospective in nature both in 2003 [79.1% (465/588)] and in 2013 [78.2%(605/774)]. Major decreases in error proportions were observed in both results presentation (χ2=24.477, σ=0.17, p<0.0001), 82.2%(263/320) compared to 66.3%(325/490) and interpretation (χ2=25.616, σ=0.173, p<0.0001), 32.5%(104/320) compared to 17.1%(84/490), though some serious ones were still present. Indian medical research seems to have made no major progress regarding using correct statistical analyses, but error/defects in study designs have decreased significantly. Randomized clinical trials are quite rarely published and have high proportion of methodological problems.

Original languageEnglish
Article numbere0121268
JournalPLoS One
Volume10
Issue number4
DOIs
Publication statusPublished - 09-04-2015

Fingerprint

Biomedical Research
Statistical methods
Research Design
statistical analysis
Randomized Controlled Trials
experimental design
Checklist
randomized clinical trials
biomedical research
Retrospective Studies
Defects
Statistical tests
Research
Surveys and Questionnaires
Acoustic waves

All Science Journal Classification (ASJC) codes

  • Medicine(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Agricultural and Biological Sciences(all)

Cite this

Hassan, S., Yellur, R., Subramani, P., Adiga, P., Gokhale, M., Iyer, M. S., & Mayya, S. S. (2015). Research design and statistical methods in Indian medical journals: A retrospective survey. PLoS One, 10(4), [e0121268]. https://doi.org/10.1371/journal.pone.0121268
Hassan, Shabbeer ; Yellur, Rajashree ; Subramani, Pooventhan ; Adiga, Poornima ; Gokhale, Manoj ; Iyer, Manasa S. ; Mayya, Shreemathi S. / Research design and statistical methods in Indian medical journals : A retrospective survey. In: PLoS One. 2015 ; Vol. 10, No. 4.
@article{fc7eda63407d49008ecd58a05e50ad04,
title = "Research design and statistical methods in Indian medical journals: A retrospective survey",
abstract = "Good quality medical research generally requires not only an expertise in the chosen medical field of interest but also a sound knowledge of statistical methodology. The number of medical research articles which have been published in Indian medical journals has increased quite substantially in the past decade. The aim of this study was to collate all evidence on study design quality and statistical analyses used in selected leading Indian medical journals. Ten (10) leading Indian medical journals were selected based on impact factors and all original research articles published in 2003 (N = 588) and 2013 (N = 774) were categorized and reviewed. A validated checklist on study design, statistical analyses, results presentation, and interpretation was used for review and evaluation of the articles. Main outcomes considered in the present study were - study design types and their frequencies, error/defects proportion in study design, statistical analyses, and implementation of CONSORT checklist in RCT (randomized clinical trials). From 2003 to 2013: The proportion of erroneous statistical analyses did not decrease (χ2=0.592, φ =0.027, p=0.4418), 25{\%} (80/320) in 2003 compared to 22.6{\%} (111/490) in 2013. Compared with 2003, significant improvement was seen in 2013; the proportion of papers using statistical tests increased significantly (χ2=26.96, φ =0.16, p< 0.0001) from 42.5{\%} (250/588) to 56.7{\%}(439/774). The overall proportion of errors in study design decreased significantly (χ2=16.783, {\"O}=0.12 p <0.0001), 41.3{\%}(243/588) compared to 30.6{\%}(237/774). In 2013, randomized clinical trials designs has remained very low (7.3{\%}, 43/588) with majority showing some errors (41 papers, 95.3{\%}). Majority of the published studies were retrospective in nature both in 2003 [79.1{\%} (465/588)] and in 2013 [78.2{\%}(605/774)]. Major decreases in error proportions were observed in both results presentation (χ2=24.477, σ=0.17, p<0.0001), 82.2{\%}(263/320) compared to 66.3{\%}(325/490) and interpretation (χ2=25.616, σ=0.173, p<0.0001), 32.5{\%}(104/320) compared to 17.1{\%}(84/490), though some serious ones were still present. Indian medical research seems to have made no major progress regarding using correct statistical analyses, but error/defects in study designs have decreased significantly. Randomized clinical trials are quite rarely published and have high proportion of methodological problems.",
author = "Shabbeer Hassan and Rajashree Yellur and Pooventhan Subramani and Poornima Adiga and Manoj Gokhale and Iyer, {Manasa S.} and Mayya, {Shreemathi S.}",
year = "2015",
month = "4",
day = "9",
doi = "10.1371/journal.pone.0121268",
language = "English",
volume = "10",
journal = "PLoS One",
issn = "1932-6203",
publisher = "Public Library of Science",
number = "4",

}

Hassan, S, Yellur, R, Subramani, P, Adiga, P, Gokhale, M, Iyer, MS & Mayya, SS 2015, 'Research design and statistical methods in Indian medical journals: A retrospective survey', PLoS One, vol. 10, no. 4, e0121268. https://doi.org/10.1371/journal.pone.0121268

Research design and statistical methods in Indian medical journals : A retrospective survey. / Hassan, Shabbeer; Yellur, Rajashree; Subramani, Pooventhan; Adiga, Poornima; Gokhale, Manoj; Iyer, Manasa S.; Mayya, Shreemathi S.

In: PLoS One, Vol. 10, No. 4, e0121268, 09.04.2015.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Research design and statistical methods in Indian medical journals

T2 - A retrospective survey

AU - Hassan, Shabbeer

AU - Yellur, Rajashree

AU - Subramani, Pooventhan

AU - Adiga, Poornima

AU - Gokhale, Manoj

AU - Iyer, Manasa S.

AU - Mayya, Shreemathi S.

PY - 2015/4/9

Y1 - 2015/4/9

N2 - Good quality medical research generally requires not only an expertise in the chosen medical field of interest but also a sound knowledge of statistical methodology. The number of medical research articles which have been published in Indian medical journals has increased quite substantially in the past decade. The aim of this study was to collate all evidence on study design quality and statistical analyses used in selected leading Indian medical journals. Ten (10) leading Indian medical journals were selected based on impact factors and all original research articles published in 2003 (N = 588) and 2013 (N = 774) were categorized and reviewed. A validated checklist on study design, statistical analyses, results presentation, and interpretation was used for review and evaluation of the articles. Main outcomes considered in the present study were - study design types and their frequencies, error/defects proportion in study design, statistical analyses, and implementation of CONSORT checklist in RCT (randomized clinical trials). From 2003 to 2013: The proportion of erroneous statistical analyses did not decrease (χ2=0.592, φ =0.027, p=0.4418), 25% (80/320) in 2003 compared to 22.6% (111/490) in 2013. Compared with 2003, significant improvement was seen in 2013; the proportion of papers using statistical tests increased significantly (χ2=26.96, φ =0.16, p< 0.0001) from 42.5% (250/588) to 56.7%(439/774). The overall proportion of errors in study design decreased significantly (χ2=16.783, Ö=0.12 p <0.0001), 41.3%(243/588) compared to 30.6%(237/774). In 2013, randomized clinical trials designs has remained very low (7.3%, 43/588) with majority showing some errors (41 papers, 95.3%). Majority of the published studies were retrospective in nature both in 2003 [79.1% (465/588)] and in 2013 [78.2%(605/774)]. Major decreases in error proportions were observed in both results presentation (χ2=24.477, σ=0.17, p<0.0001), 82.2%(263/320) compared to 66.3%(325/490) and interpretation (χ2=25.616, σ=0.173, p<0.0001), 32.5%(104/320) compared to 17.1%(84/490), though some serious ones were still present. Indian medical research seems to have made no major progress regarding using correct statistical analyses, but error/defects in study designs have decreased significantly. Randomized clinical trials are quite rarely published and have high proportion of methodological problems.

AB - Good quality medical research generally requires not only an expertise in the chosen medical field of interest but also a sound knowledge of statistical methodology. The number of medical research articles which have been published in Indian medical journals has increased quite substantially in the past decade. The aim of this study was to collate all evidence on study design quality and statistical analyses used in selected leading Indian medical journals. Ten (10) leading Indian medical journals were selected based on impact factors and all original research articles published in 2003 (N = 588) and 2013 (N = 774) were categorized and reviewed. A validated checklist on study design, statistical analyses, results presentation, and interpretation was used for review and evaluation of the articles. Main outcomes considered in the present study were - study design types and their frequencies, error/defects proportion in study design, statistical analyses, and implementation of CONSORT checklist in RCT (randomized clinical trials). From 2003 to 2013: The proportion of erroneous statistical analyses did not decrease (χ2=0.592, φ =0.027, p=0.4418), 25% (80/320) in 2003 compared to 22.6% (111/490) in 2013. Compared with 2003, significant improvement was seen in 2013; the proportion of papers using statistical tests increased significantly (χ2=26.96, φ =0.16, p< 0.0001) from 42.5% (250/588) to 56.7%(439/774). The overall proportion of errors in study design decreased significantly (χ2=16.783, Ö=0.12 p <0.0001), 41.3%(243/588) compared to 30.6%(237/774). In 2013, randomized clinical trials designs has remained very low (7.3%, 43/588) with majority showing some errors (41 papers, 95.3%). Majority of the published studies were retrospective in nature both in 2003 [79.1% (465/588)] and in 2013 [78.2%(605/774)]. Major decreases in error proportions were observed in both results presentation (χ2=24.477, σ=0.17, p<0.0001), 82.2%(263/320) compared to 66.3%(325/490) and interpretation (χ2=25.616, σ=0.173, p<0.0001), 32.5%(104/320) compared to 17.1%(84/490), though some serious ones were still present. Indian medical research seems to have made no major progress regarding using correct statistical analyses, but error/defects in study designs have decreased significantly. Randomized clinical trials are quite rarely published and have high proportion of methodological problems.

UR - http://www.scopus.com/inward/record.url?scp=84929484368&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84929484368&partnerID=8YFLogxK

U2 - 10.1371/journal.pone.0121268

DO - 10.1371/journal.pone.0121268

M3 - Article

C2 - 25856194

AN - SCOPUS:84929484368

VL - 10

JO - PLoS One

JF - PLoS One

SN - 1932-6203

IS - 4

M1 - e0121268

ER -

Hassan S, Yellur R, Subramani P, Adiga P, Gokhale M, Iyer MS et al. Research design and statistical methods in Indian medical journals: A retrospective survey. PLoS One. 2015 Apr 9;10(4). e0121268. https://doi.org/10.1371/journal.pone.0121268