Minority Health Archive

Statistical analysis of the National Institutes of Health peer review system

Johnson, Valen E. (2008) Statistical analysis of the National Institutes of Health peer review system. PNAS, 105 (32). pp. 11076-11080.

Full text not available from this repository.


A statistical model is proposed for the analysis of peer-review ratings of R01 grant applications submitted to the National Institutes of Health. Innovations of this model include parameters that reflect differences in reviewer scoring patterns, a mechanism to account for the transfer of information from an application's preliminary ratings and group discussion to final ratings provided by all panel members and posterior estimates of the uncertaninty associated with proposal ratings. Application of this model to recent R01 rating data suggests that statistical adjustments to panel rating data would lead to a 25% change in the pool of funded proposals. viewed more broadly, the methodology propsed in this article provides a general framework for the analysis of data collected interactively from expert panels through the use of the Delphi method and related procedures.

Export/Citation:EndNote | BibTeX | Dublin Core | ASCII (Chicago style) | HTML Citation | OpenURL | Reference Manager
Social Networking:

Item Type: Article
Additional Information: Access to full text is subject to the publisher's access restrictions.
Uncontrolled Keywords: hierarchical model, item response model, latent variable model, ordinal data
Subjects: Health
Research > methodologies
Related URLs:
Depositing User: Users 141 not found.
Date Deposited: 03 Oct 2008
Last Modified: 01 May 2011 12:53
Link to this item (URI): http://health-equity.lib.umd.edu/id/eprint/1047

Actions (login required)

View Item