Journal of Postgraduate Medicine
 Open access journal indexed with Index Medicus & ISI's SCI  
Users online: 9460  
Home | Subscribe | Feedback | Login 
About Latest Articles Back-Issues Article Submission Resources Sections Etcetera Contact
 
  NAVIGATE Here 
  Search
 
  
 RESOURCE Links
 ::  Similar in PUBMED
 ::  Search Pubmed for
 ::  Search in Google Scholar for
 ::  Article in PDF (240 KB)
 ::  Citation Manager
 ::  Access Statistics
 ::  Reader Comments
 ::  Email Alert *
 ::  Add to My List *
* Registration required (free) 

  IN THIS Article
 ::  References
 ::  Article Tables

 Article Access Statistics
    Viewed2689    
    Printed73    
    Emailed5    
    PDF Downloaded15    
    Comments [Add]    
    Cited by others 5    

Recommend this journal


 


 
  Table of Contents     
LETTER
Year : 2011  |  Volume : 57  |  Issue : 3  |  Page : 264-265

How honest is the h-index in measuring individual research output?


Department of Community Medicine, School of Public Health, PGIMER, Chandigarh, India

Date of Web Publication22-Sep-2011

Correspondence Address:
B K Patro
Department of Community Medicine, School of Public Health, PGIMER, Chandigarh
India
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/0022-3859.85233

Rights and Permissions




How to cite this article:
Patro B K, Aggarwal A K. How honest is the h-index in measuring individual research output?. J Postgrad Med 2011;57:264-5

How to cite this URL:
Patro B K, Aggarwal A K. How honest is the h-index in measuring individual research output?. J Postgrad Med [serial online] 2011 [cited 2019 Nov 17];57:264-5. Available from: http://www.jpgmonline.com/text.asp?2011/57/3/264/85233


Sir,

Measuring the impact of the research output of an institution / individual is an important issue. It helps in the evaluation and comparison of the research output of institutions as well as individual researchers. Any research study is said to have achieved its purpose when its results are translated into policy, which further rolls out as a change in the program or practice guidelines. However, these changes usually follow the cumulative effect of multiple research studies, thus making it difficult to ascribe the credit to an individual researcher.

Several bibliometric indicators have been developed to measure the output of research studies or publications, of which a number of publications and publications in high impact factor journals are the most popular ones. The number of publications is limited in its ability as an indicator of research output, as it speaks only about the volume of research, ignoring the quality. Publication in a high impact factor journal certainly points to the quality of the research study, but the impact factor is assigned to the journal as a whole rather than to the individual research publication.

The impact factor of a journal is the average number of citations received per article published in that journal, during the two preceding years. A journal's impact factor is based on two elements: the numerator, which is the number of citations in the current year compared to items published in the previous two years, and the denominator, which is the number of substantive articles and reviews published in the same two years. Substantive articles usually include articles, reviews, proceedings, or notes but not editorials or letters-to-the-editor. [1] The impact factor of journals remains to be a contentious issue and has drawn criticisms from the scientific community regarding its use to evaluate research studies. [2] It can be manipulated by changing editorial policies such as increasing the number of review articles or reducing the number of original articles, ahead of print publication (online first) or by encouraging authors for self citation. A summary of the commonly used bibliographic indicators are presented in [Table 1].
Table 1: Advantages and disadvantages of commonly used bibliographic indicators


Click here to view


The h-index was proposed in the year 2005, by J.E. Hirsch, to overcome the shortcomings of the Impact Factor in evaluating the impact of an individual researcher's research output. The h-index attempts to measure both the volume and impact of the published study of a scientist or scholar. Index h, is defined as the number of articles with ≥ h citations. A researcher has an index h if the h of his or her N p articles have been cited at least h number of times and the remaining (N p - h) articless have been cited ≤ h times. An h-index of 10 translates to 10 research publications of a researcher having been cited at least 10 times. The h-index grows as the citations accumulate over a period of time, and thus, it depends on the 'academic age' of a researcher. [3] Hirsch originally suggested for faculty of research universities that h ~ 12 might be a typical value for advancement to associate professor, and h ~ 18 might be typical value for advancement to full professor.

The h-index can be manually calculated using citation databases. Subscription base databases, such as, Scopus and Web of Knowledge, provide automatic calculation of the h-index. Each database is likely to produce a different h value for the same researcher owing to different subscriptions (coverage of journals). Google scholar also provides a h value, which happens to be on the higher side than that of Scopus and Web of Knowledge.

The h-index has its own pie of limitations and criticisms. One of the major limitations of the h index is its insensitiveness to the small number studies, which are highly cited. Similarly, it does not take account of the large number articles, which have less than h citations. As the h-index is dependent on the number of publications, a junior researcher with a relatively short research career is likely to have a disappointingly low h-index despite his innovations. The h-index also does not account for the positioning of the researchers in the list of authors. [4]

The limitations of the h-index have been addressed by new bibliometric indicators such as the m and h core index.

Despite its limitations it is being used to evaluate researchers for career advancement in universities and medical schools across the globe. The h-index seems to be a promising index for measuring the scientific output of a researchers, but should not be used in isolation. In addition, other measures of research output measures such as innovations and societal impact should also be considered in measuring the scientific output of a researcher.

 
 :: References Top

1.Garfield E. The history and meaning of the journal impact factor. JAMA 2006;295:90-3.  Back to cited text no. 1
    
2.Seglen PO. Why the impact factor of journals should not be used for evaluating research. BMJ 1997;314:498-502.   Back to cited text no. 2
    
3.Hirsch JE. An index to quantify an individual's scientific research output. Proc Natl Acad Sci U S A 2005;102:16569-72.  Back to cited text no. 3
    
4.Thompson DF, Callen EC, Nahata MC. New indices in scholarship assessment. Am J Pharm Educ 2009;73:111.  Back to cited text no. 4
    



 
 
    Tables

  [Table 1]

This article has been cited by
1 Gender Differences in Promotion and Scholarly Impact: An Analysis of 1460 Academic Ophthalmologists
Santiago A. Lopez,Peter F. Svider,Poonam Misra,Neelakshi Bhagat,Paul D. Langer,Jean Anderson Eloy
Journal of Surgical Education. 2014;
[Pubmed] | [DOI]
2 Gender disparities in scholarly productivity within academic otolaryngology departments
Eloy, J.A. and Svider, P. and Chandrasekhar, S.S. and Husain, Q. and Mauro, K.M. and Setzen, M. and Baredes, S.
Otolaryngology - Head and Neck Surgery (United States). 2013; 148(2): 215-222
[Pubmed]
3 The use of the h-index in academic otolaryngology
Svider, P.F. and Choudhry, Z.A. and Choudhry, O.J. and Baredes, S. and Liu, J.K. and Eloy, J.A.
Laryngoscope. 2013; 123(1): 103-106
[Pubmed]
4 The use of theh-indexin academic otolaryngology
Peter F. Svider,Zaid A. Choudhry,Osamah J. Choudhry,Soly Baredes,James K. Liu,Jean Anderson Eloy
The Laryngoscope. 2013; 123(1): 103
[Pubmed] | [DOI]
5 Assessing National Institutes of Health funding and scholarly impact in neurological surgery
Peter F. Svider,Qasim Husain,Adam J. Folbe,William T. Couldwell,James K. Liu,Jean Anderson Eloy
Journal of Neurosurgery. 2013; : 1
[Pubmed] | [DOI]



 

Top
Print this article  Email this article
 
Online since 12th February '04
2004 - Journal of Postgraduate Medicine
Official Publication of the Staff Society of the Seth GS Medical College and KEM Hospital, Mumbai, India
Published by Wolters Kluwer - Medknow