CINXE.COM

<script>(function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start': new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0], j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src= 'https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f); })(window,document,'script','dataLayer','GTM-T2DH393N');</script>  <HTML lang="en-US">  <HEAD> <TITLE>NOT-OD-23-034: Request for Information (RFI) on Proposed Simplified Review Framework for NIH Research Project Grant Applications</TITLE> <META NAME="description" CONTENT="NIH Funding Opportunities and Notices in the NIH Guide for Grants and Contracts: Request for Information (RFI) on Proposed Simplified Review Framework for NIH Research Project Grant Applications NOT-OD-23-034. NIH"> <META NAME="Keywords" CONTENT="NOT-OD-23-034: Request for Information (RFI) on Proposed Simplified Review Framework for NIH Research Project Grant Applications"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> <link href="../guide_styles/css/bootstrap.min.css" rel="stylesheet" media="screen"> <link href="../guide_styles/css/style.css" rel="stylesheet" media="screen"> <link href="../guide_styles/css/FOAM_Style.css" rel="stylesheet"> </HEAD> <BODY> <div class="container"> <div class="row"> <div class="col-xs-12"> <body onload="initContent()"> <div class="container"> <div class="row"> <div id="page-title" class="heading1" tabindex="0"></div> <div> <div data-element-id="1680" data-element-has-label="false" data-element-required="true" data-element-has-value="true" data-section-code="OI" data-element-type="LINKED_ELEMENT"> <span class="title">Request for Information (RFI) on Proposed Simplified Review Framework for NIH Research Project Grant Applications </span> </div> <div class="heading4" tabindex="0" data-element-id="1679" data-element-required="true" data-element-has-value="true" data-section-code="OI" data-element-type="LINKED_ELEMENT"> Notice Number: </div> <div data-element-id="1679" data-element-has-label="true" data-element-required="true" data-element-has-value="true" data-section-code="OI" data-element-type="LINKED_ELEMENT"> <span class="noticenum">NOT-OD-23-034</span> </div> <div data-element-id="1681" data-element-has-label="false" data-element-required="true" data-element-has-value="true" data-section-code="OI" data-element-type="TEXT"> <a name="_Key_Dates"></a><h2 class="heading2">Key Dates</h2> </div> <div class="row" data-index="4"> <div class="col-md-4 datalabel" tabindex="0" data-element-id="1682" data-element-required="false" data-element-has-value="true" data-section-code="OI" data-element-type="TEXT"> Release Date: </div> <div class=" col-md-8 datacolumn"> <p class="Normal">December 8, 2022</p> </div> </div> <div class="row" data-index="5"> <div class="col-md-4 datalabel" tabindex="0" data-element-id="1691" data-element-required="false" data-element-has-value="true" data-section-code="OI" data-element-type="DATE"> Response Date: </div> <div class=" col-md-8 datacolumn"> March 10, 2023 </div> </div>  <div data-element-id="1683" data-element-has-label="false" data-element-required="true" data-element-has-value="true" data-section-code="OI" data-element-type="TEXT"> <a name="_"></a><h2 class="heading2">Related Announcements</h2> </div> <div data-element-id="1684" data-element-has-label="false" data-element-required="true" data-element-has-value="true" data-section-code="OI" data-element-type="TEXT"> <li><strong>November 21, 2024</strong> - Reminder that Multiple Changes Affecting Extramural Applications and Review are Coming for Application Due Dates on or After January 25, 2025. See Notice <a href="https://grants.nih.gov/grants/guide/notice-files/NOT-OD-25-035.html">NOT-OD-25-035</a>.</li> <p><a href="//grants.nih.gov/grants/guide/notice-files/NOT-OD-24-085.html">NOT-OD-24-085</a> - Simplified Review Framework for NIH Research Project Grant Applications - Update and Implementation Plans</p> <p><a href="//grants.nih.gov/grants/guide/notice-files/NOT-OD-24-084.html">NOT-OD-24-084</a> - Overview of Grant Application and Review Changes for Due Dates on or after January 25, 2025.</p> <p><a href="//grants.nih.gov/grants/guide/notice-files/NOT-OD-24-012.html">NOT-OD-24-012</a> - Online Briefing on NIHs Simplified Peer Review Framework for NIH Research Project Grant (RPG) Applications: for Applicants and Reviewers</p> <p><a href="//grants.nih.gov/grants/guide/notice-files/NOT-OD-24-010.html">NOT-OD-24-010</a> - Simplified Review Framework for NIH Research Project Grant Applications</p> </div> <div data-element-id="1685" data-element-has-label="false" data-element-required="true" data-element-has-value="true" data-section-code="OI" data-element-type="TEXT"> <a name="_"></a><h2 class="heading2">Issued by</h2> </div> <div data-element-id="1686" data-element-has-label="false" data-element-required="true" data-element-has-value="true" data-section-code="OI" data-element-type="LINKED_ELEMENT"> <p>NATIONAL INSTITUTES OF HEALTH (<a href="${issuingComponent.orgLink}" target="_blank" rel="noreferrer">NIH</a>) </div> <div data-element-id="1687" data-element-has-label="false" data-element-required="true" data-element-has-value="true" data-section-code="OI" data-element-type="TEXT"> <a name="_"></a><h2 class="heading2">Purpose</h2> </div> <div data-element-id="1688" data-element-has-label="false" data-element-required="true" data-element-has-value="true" data-section-code="OI" data-element-type="TEXT"> <p class="Normal">The purpose of this Request for Information (RFI) is to solicit public input on a proposed revised framework for evaluating and scoring peer review criteria for National Institutes of Health (NIH) research project grant (RPG) applications. NIH is proposing a revised simplified framework that will reorganize five major regulatory criteria under three scored categories and reduce the number of non-score driving review considerations that reviewers evaluate in judging the scientific merit of RPG applications. The proposed changes pertain to those RPGs with standard review criteria. All the factors required by regulation will continue to be evaluated. NIH is not proposing to revise the regulatory criteria. Rather, NIH is proposing to revise its policy of how peer reviewers score the criteria, and how NIH organizes the criteria for review purposes. NIH believes that these changes will allow peer reviewers to refocus on the critical task of judging scientific merit and will improve those judgements by reducing bias.</p> <p class="heading4"><b>Current Process</b></p> <p class="Normal">The first stage of NIH peer review serves to provide expert advice to NIH on the scientific and technical merit of grant applications. The NIH peer review regulations at <a href="https://www.ecfr.gov/current/title-42/chapter-I/subchapter-D/part-52h">42 C.F.R. Part 52h.8</a> state that for research project grant applications,</p> <p class="Normal"><i>the scientific peer review group shall assess the overall impact that the project could have on the research field involved, taking into account, among other pertinent factors: </i></p> <ol style="list-style-type:lower-alpha"> <li class="Normal"><i>The significance of the goals of the proposed research, from a scientific or technical standpoint; </i></li> </ol> <ol start="2" style="list-style-type:lower-alpha"> <li class="Normal"><i>Approach: The adequacy of the approach and methodology proposed to carry out the research; </i></li> </ol> <ol start="3" style="list-style-type:lower-alpha"> <li class="Normal"><i>Innovation: The innovativeness and originality of the proposed research; </i></li> </ol> <ol start="4" style="list-style-type:lower-alpha"> <li class="Normal"><i>Investigator(s): The qualifications and experience of the principal investigator and proposed staff; </i></li> </ol> <ol start="5" style="list-style-type:lower-alpha"> <li class="Normal"><i>Environment: The scientific environment and reasonable availability of resources necessary to the research; </i></li> </ol> <ol start="6" style="list-style-type:lower-alpha"> <li class="Normal"><i>The adequacy of plans to include both genders, minorities, children and special populations as appropriate for the scientific goals of the research; </i></li> </ol> <ol start="7" style="list-style-type:lower-alpha"> <li class="Normal"><i>The reasonableness of the proposed budget and duration in relation to the proposed research; and </i></li> </ol> <ol start="8" style="list-style-type:lower-alpha"> <li class="Normal"><i>The adequacy of the proposed protection for humans, animals, and the environment, to the extent they may be adversely affected by the project proposed in the application.</i></li> </ol> <p class="Normal">By <a href="https://grants.nih.gov/grants/policy/nihgps/HTML5/section_2/2.4.1_initial_review.htm#Addition">NIH policy,</a> peer reviewers are currently also required to evaluate Biohazards, Resubmissions, Foreign Organizations, Select Agents, Resource Sharing Plans, and Authentication of Key Biological and/or Chemical Resources. NIH currently gives the first five of the regulatory factors the following categorical labels: Significance, Approach, Innovation, Investigator(s), and Environment.</p> <p class="Normal">The NIH peer review regulation does not address scoring. Scoring of all regulatory factors is determined by NIH policy. Currently, peer reviewers provide an Overall Impact Score (scored 1-9) that reflects the overall scientific and technical merit of the application and individual criterion scores for Significance, Investigators, Innovation, Approach, and Environment. The remaining factors, Protections for Human Subjects, Inclusion, Vertebrate Animals, Biohazards, Resubmission, Renewal, and Revision are evaluated and factored into the Overall Impact Score; however, they are not given individual scores. When reviewers judge any of these to be unacceptable, they are asked to provide justification for that assessment. Beyond these factors, reviewers are asked to assess the following additional review considerations, but these considerations are not considered when reviewers determine an Overall Impact Score: Applications from Foreign Organizations, Select Agents, Resource Sharing Plans, Authentication of Key Biological and/or Chemical Resources, Budget & Period of Support.</p> <p class="heading4"><b>Proposal Development</b></p> <p class="Normal">NIH gathered input from many sources in forming this proposal. Unsolicited comments over a period of years, reflecting sustained concerns from reviewers and applicants regarding complexity of review criteria, administrative load, and potential biases led the Center for Scientific Review (CSR) to form a working group to the CSR Advisory Council. To inform that group, CSR published a <a href="https://www.csr.nih.gov/reviewmatters/2020/02/27/seeking-your-input-on-simplifying-review-criteria/">Review Matters</a> blog which was cross-posted on the Office of Extramural Research blog, <a href="https://nexus.od.nih.gov/all/2020/02/27/seeking-your-input-on-simplifying-review-criteria/">Open Mike</a>. The blog received more than 9,000 views by unique individuals and over 400 comments. The working group presented <a href="https://public.csr.nih.gov/sites/default/files/2019-10/Review_criteria_wg_CSRAC_interim_report_7April2020.pdf">interim recommendations</a> to the CSR Advisory Council, which adopted the recommendations, at public CSR Advisory Council meetings (March 2020 <a href="https://videocast.nih.gov/summary.asp?live=35649&bhcp=1&start=4307">video</a>, <a href="https://public.csr.nih.gov/sites/default/files/presentations/200330/Simplifying_Review_Criteria_Workgroup_Interim_Rpt_final.pdf">slides</a>; March 2021 <a href="https://videocast.nih.gov/watch=41574&start=4816">video</a>, <a href="https://public.csr.nih.gov/sites/default/files/2021-04/Simplifying_Review_Criteria_29_March_2021.pdf">slides</a>). Final recommendations from the CSR Advisory Council (<a href="https://public.csr.nih.gov/sites/default/files/2021-04/Recommendations_of_the_CSRAC_Working_Group_on_Simplifying_Review-non-CT_and_CT.pdf">report</a>) were considered by the CSR Director, as well as major internal NIH extramural-focused committees that included leadership from across NIH institutes and centers. This process produced many modifications and the final proposal presented below. Additional background information can be found <a href="https://grants.nih.gov/policy/peer/Proposed-Framework/index.htm">here</a>.</p> <p class="heading4"><b>Proposed Revised Simplified Review Framework</b></p> <p class="Normal">An Overall Impact Score (scored 1-9) will reflect the overall scientific and technical merit of the application. Reviewers will take into account their assessments of the three factors below and the following additional criteria in determining an Overall Impact Score. Of the three factors, only Factor 1: Importance of the Research and Factor 2: Feasibility and Rigor, will receive individual scores. In the revised framework, Factor 3: Expertise and Resources will not receive an individual score. The additional review criteria below will not receive individual scores but will be considered in arriving at the Overall Impact Score. Two review considerations will be evaluated but have no effect on the Overall Impact Score. Detailed descriptions of the three factors can be found <a href="https://grants.nih.gov/policy/peer/Proposed-Framework/reviewer-guidance.htm">here</a>.</p> <p class="Normal"><b>Factor 1: Importance of the Research (scored 1-9) </b></p> <p class="Normal" style="margin-left: 25px;">Factor 1 is based on the criteria <i>Significance</i> and <i>Innovation</i>.</p> <p class="Normal"><b>Factor 2: Feasibility and Rigor (scored 1-9) </b></p> <p class="Normal" style="margin-left: 25px;">Factor 2 is based on the criterion <i>Approach</i>.</p> <p class="Normal"><b>Factor 3: Expertise and Resources (rated as fully capable , appropriate or additional capability/expertise needed or additional resources needed )</b></p> <p class="Normal" style="margin-left: 25px;">Factor 3 is based on the criteria <i>Investigator</i> and <i>Environment</i>. If additional expertise/capability needed or additional resources needed is selected, justification must be provided.</p> <p class="Normal"><b>Additional Criteria (not scored, but affecting Overall Impact):</b></p> <ul> <li class="Normal">Human Subject Protections</li> <li class="Normal">Inclusion of Women, Minorities, and Individuals Across the Lifespan</li> <li class="Normal">Vertebrate Animals</li> <li class="Normal">Biohazards</li> <li class="Normal">Resubmission/Renewal/Revisions</li> </ul> <p class="Normal">Each of the Additional Criteria except the last will be rated as Appropriate , with no comments required, or as Concerns , which must be briefly justified. Resubmission/Renewal/Revisions will be given brief written evaluations.</p> <p class="Normal"><b>Additional Review Considerations (not scored and having no effect on Overall Impact): </b></p> <ul> <li class="Normal">Authentication of Key Biological and/or Chemical Resources</li> </ul> <ul style="margin-left: 25px;"> <li class="Normal">Rated as Appropriate with no comments required, or as Concerns , which must be briefly described.</li> </ul> <ul> <li class="Normal">Budget and Period of Support</li> </ul> <ul style="margin-left: 25px;"> <li class="Normal">Rated as Appropriate , Excessive , or Inadequate ; the latter two ratings requiring a brief account of concerns.</li> </ul> <p class="Normal">The additional review considerations, including Foreign Organizations, Select Agents, and Resource Sharing Plans, will no longer be evaluated by peer reviewers.</p> <p class="Normal">Restructuring the categorization and scoring of criteria in this way reduces the number of scores reviewers need to provide, and policy considerations reviewers need to take into account when evaluating scientific merit. It focuses reviewers on the two most important judgements about a proposed research project; how important the research is, and how rigorous and feasible the approach is. Evaluation of the investigators and research environment is framed in terms of whether the expertise and resources needed to accomplish the project are available, thus diminishing halo effects-- diffuse judgements of investigator or institutional reputation that bias judgements of research importance, rigor, and feasibility.</p> <p class="heading4"><b>90-day Comment Period</b></p> <p class="Normal">Comments must be received by 11:59:59 PM (ET) on March 10, 2023, to ensure consideration.</p> <p class="heading4"><b>Information Requested</b></p> <p class="Normal">NIH is specifically requesting public comment on the Proposed Revised Simplified Review Framework, a proposed revised framework for evaluating and scoring peer review criteria for NIH research project grant applications, described above. Response to this RFI is voluntary.</p> <p class="heading4"><b>Submitting a Response</b></p> <p class="Normal">Comments should be submitted electronically to the following webpage at: <a href="https://rfi.grants.nih.gov/?s=638509b5409baa49f803e572">https://rfi.grants.nih.gov/?s=638509b5409baa49f803e572</a>.</p> <p class="Normal">This RFI is for planning purposes only and should not be construed as a policy, solicitation for applications, or as an obligation on the part of the Government to provide support for any ideas identified in response to it. Please note that the Government will not pay for the preparation of any information submitted or for its use of that information.</p> <p class="Normal">Please do not include any proprietary, classified, confidential, or sensitive information in your response. Responses will be compiled and a content analysis will be shared publicly after the close of the comment period. The NIH may use information gathered by this Notice to inform future policy development.</p> </div> <div data-element-id="1689" data-element-has-label="false" data-element-required="true" data-element-has-value="true" data-section-code="OI" data-element-type="TEXT"> <a name="_"></a><h2 class="heading2">Inquiries</h2> <p>Please direct all inquiries to:</p> </div> <div data-element-id="1690" data-element-has-label="false" data-element-required="false" data-element-has-value="true" data-section-code="OI" data-element-type="TEXT"> <p class="Normal"><a href="/cdn-cgi/l/email-protection#03706a6e736f6a656a66677166756a6674436d6a6b2d646c75"><span class="__cf_email__" data-cfemail="3d4e54504d51545b5458594f584b54584a7d535455135a524b">[email protected]</span></a>.</p> </div> </div> </div>  </div> <script data-cfasync="false" src="/cdn-cgi/scripts/5c5dd728/cloudflare-static/email-decode.min.js"></script></body> </div> </div> <div class="row"> <div class="col-xs-12"> <P> <HR> <A HREF="/grants/guide/WeeklyIndex.cfm?12-09-22">Weekly TOC for this Announcement</A><br> <A HREF="/grants/guide/index.html">NIH Funding Opportunities and Notices</A> <hr> </div> </div> <link rel="stylesheet" type="text/css" media="print" href="css/notices_print.css " /> <div class="row"> <div class="footer"> <div class="col-sm-4"> <a href="/grants/oer.htm"><img src="/images7/nih-oer-logo.jpg" alt="NIH Office of Extramural Research Logo" usemap="#Map2" border="0"></a> <map name="Map2" id="Map2"> <area shape="rect" coords="89,17,359,39" href="http://www.nih.gov" /> <area shape="rect" coords="91,39,286,58" href="https://grants.nih.gov/grants/oer.htm" /> <area shape="rect" coords="3,5,78,55" href="https://grants.nih.gov/grants/oer.htm" /> </map> </div> <div class="col-sm-4"> <div style="float:left; padding: 5 5 5 70"> <a href="https://www.hhs.gov/"><img src="/images7/dhhs_sm.gif" width="36" height="37" border="0" alt="Department of Health and Human Services (HHS) - Home Page" long desc="Logo, circular in shape, depicting an American eagle in-flight with stylized profiles of human faces appearing on the trailing edge of the wings. The perimeter of the logo is encircled with the words 'Department of Health and Human Services U S A'"></a></div> <div style="padding: 5 5 5 5;">Department of Health<br> and Human Services (HHS)</div> </div> <div class="col-sm-4"> <div style="padding: 5 5 5 0" align="center"> <a href="https://www.usa.gov/"><img src="/images7/USA_Gov_logo.gif" border="0" alt="USA.gov - Government Made Easy" long desc="Logo,- the words 'USA.gov - Government Made Easy' with single streaking star above the logo"></a> </div> </div> </div> </div> <div class="row"> <div class="footer"> <div class="col-xs-12" align="center" style="padding: 20 5 5 5"> <span style="color:#6E6E6E; font-size:1.0em; font-family: 'Trebuchet MS', Arial, Helvetica, sans-serif">NIH... Turning Discovery Into Health<sup>®</sup></span> </div> </div> </div> <div class="row"> <div class="footer"> <div class="col-xs-12" align="center"> </div> </div> </div> </div> </BODY> </HTML>