Deakin University – InternalAssessment

NHMRC Project Grant 2018

Reviewer Name
CIA Name
Application Title

INSTRUCTIONS:

  1. Using the ASSESSMENT CRITERIAand CATEGORY DESCRIPTORS, please read the application, assess and complete the ASSESSMENT CRITERIA table below and provide constructive feedback.
  1. Return your assessment feedback to

The aim of the assessment is to provide grantsmanship and/or constructive comments that an applicant can incorporate to strengthen their application and to score applications against the assessment criteria in order to determine (once actual outcomes are known) whether we need to build assessor skills in accurately determining the calibre/competitiveness of grant applications.

Deakin Research – Grants will record your scores but remove these before comments are sent to the applicant.

ASSESSMENT CRITERIA / COMMENTS / SCORE
(1-7)*
Scientific Quality (50%)
This includes the clarity of the hypotheses or research objectives, the strengths and weaknesses of the study design and feasibility.
Applications may be assessed in terms of, but not limited to the following questions.
a) Clarity of the hypothesis or research objectives.
i.Has the method/framework/approach been partially tested?
ii.What outcome is sought in the proposed study? What exactly is the outcome measure?
iii. Is it well integrated and adequately developed?
b) Is there a clear and appropriate research plan?
i.What are the strengths and weaknesses of the study design?
ii.Have any major pitfalls or problems been overlooked? Are there more advanced and appropriate alternative approaches that should be used or considered?
iii.Is the plan well informed by knowledge of the literature?
iv. Is the design appropriate for the aims of the research?
c) Feasibility.
i.Does the research team, including AIs, have all the required tools and techniques established in their laboratories?
ii.Does the research team, including AIs, have all the expertise required to successfully complete the research plan?
iii.Is the team, including AIs, operating in an appropriately supportive research environment?
Significance and/or Innovation (25%)
Significance
• Would the likely outcome of this study significantly advance knowledge in this field?
• If successful, will the study have a significant impact on the health issue at question? o Impact could be measured by advancement in general scientific knowledge, clinical and/or public health applications, policy development or change
o NB: The significance of the study is not a measure of the prevalence/incidence of the health issue (e.g. cancer versus sudden infant death syndrome)
• What is the likely interest from other researchers, conference organisers, journals, community groups, and policy makers in the outcomes of the research?
AND/OR
Innovation
• Is the proposed research new/novel or creative (has imagination been used)?
• Are the aims transformative?
• Are the techniques cutting edge?
• If successful, could the research result in a paradigm shift?
• Will the research affect current practices or approaches and other researchers within this field of research?
• Is the research proposal a strong candidate for the Marshall and Warren Award?
• Is the proposed study innovative enough that it will be the subject of invited plenary presentations at international meetings?
• Is it likely that the results from the study will yield highly influential publications?
• How well does the proposal describe the new ideas, procedures, technologies, programs or health policy settings?
Team Quality & Capability relevant to this application (25%)
Team Quality and Capability is considered in terms of whether an applicant’s previous research demonstrates that the CI(s) is capable of achieving the proposed project and/or ability to deliver the proposed project in terms of having the appropriate mix of research skills and experience.
Where an application involves a CI team, the combined track record of all CIs is considered and each CI will be assessed relative to opportunity (including career stage). The inclusion of ECRs is strongly encouraged for all research teams. AIs are not considered as part of the team track record.
Team Q C may encompass the national and international standing of the applicant(s) based upon their research achievements, including but not limited to:
• research outputs relevant to the proposed field of research (most recent significant publications, publications that illustrate innovation and significance to past accomplishments, impact or outcome of previous research achievements, including effects on health care practices or policy, awards or honours in recognition of achievements);
• contribution to discipline or area (invitations to speak at international meetings, editorial appointments, specialist and high level health policy committee appointments);
• other research-related achievements (influence on clinical/health policy or practice or provision of influential advice to health authorities and government, impacts on health via the broad dissemination of research outcomes; e.g. via mainstream media, the community or industry involvement); and
• Mentoring environment to support junior/emerging researchers.
Team Quality and Capability is considered in relation to opportunity – with regard to factors such as career disruption, administrative and clinical/teaching load, and typical performance (including publications) for the field in question.
ADDITIONAL/GENERAL COMMENTS
OVERALL SCORE / #To calculate, click on overall score number and press F9. / 0.000#

* Refer to Category Descriptors on following page to guide your scoring

Table 12017NHMRC PROJECT GRANT CATEGORY DESCRIPTORS (

CATEGORY / ScientificQuality50%(FeasibilitycanincludecontributionofAssociateInvestigators) / Significanceand/orInnovation25%
SignificanceofthepotentialoutcomesAND/ORInnovationoftheconcept / Team(doesNOTincludeAssociateInvestigators)QualityCapabilityrelevanttothisapplication25%-Relativetoopportunity
7 OutstandingbyInternationalStandards / Theproposal hasa researchplanthat:
  • iswell-defined,highlycoherentandstronglydeveloped.
  • hasa near flawlessstudy design.
  • ishighlyfeasiblewithalloftherequired expertise,researchtoolsandtechniquesestablished.
  • wouldbehighly competitivewith the best,similarresearchproposalsinternationally.
/ Theplannedresearch:
  • willresultin a highlysignificant advanceinknowledgeinthisfieldwhichaddressesanissueofgreatimportance tohumanhealth.
  • willresult infundamentaloutcomesinthescienceunderpinninghumanhealthissues.
  • will provide outcomes that represent outstanding value for money
  • willtranslaterapidlyinto fundamental or commercialisableoutcomesthat will transformthepractice ofclinicalmedicine,publichealthor inhealthpolicy.
  • willalmostcertainlybe the subjectofinvitedplenarypresentationsatnationalandinternationalmeetings.
  • willalmostcertainlyresultinhighlyinfluentialpublications.
  • ishighlyinnovativeandintroducesadvancesinconcept(s).
  • willuseveryadvancedapproacheswhichwilloptimizeoutcomes.
/ Relative to opportunity,theapplicantteam:
  • hasexpertisethatspecificallytargetstheproposedresearchbothintermsofitsdepthand/orbreadth.
  • hasoverthelast 5 years,acombinedrecordofresearchachievementthatisoutstandingbyinternationalstandardscommensurate withtheir fieldofresearch.
•research achievement may include contributions to translational outcomes such as patents, commercial outputs, and public policy or implementation of change in practice
•research quality as exemplified in the top 5 publications of each CI
•research productivity as exemplified by total outputs for the team
  • hassenior memberswithoutstandingnationalinternationalreputationsinthefield ofresearch relevanttotheapplication.
  • may involvejuniormemberswhoareverystrongcontributorstotheoverallteam qualitycapability orwillhave the capacityto doso duetothe availability ofverystrongmentoringbyothermembersof theteam.

6 Excellent / Theproposalhasa researchplanthat:
  • isclearlydefined,coherentand welldeveloped.
  • hasa strongstudydesign.
  • isfeasiblewithallrequiredtools,techniquesandexpertiseestablished.
  • islikelyto becompetitivewithstrong,similarresearchproposalsinternationally.
/ Theplannedresearch:
  • willresultin a significantadvanceinknowledgeinthisfieldwhichaddressesanissue ofimportance tohumanhealth.
  • islikelyto result infundamentaloutcomesinthescienceunderpinninghumanhealthissues.
  • will provide outcomes that represent excellent value for money
  • islikelyto translateinto fundamentalor commercialisableoutcomesthat will transformthepractice ofclinicalmedicine,publichealthor inhealthpolicy.
  • willlikelybe the subjectofinvitedplenarypresentationsatnationalandinternationalmeetings.
  • willlikelyresultininfluentialpublications.
  • ishighlyinnovativeinconcept.
  • willuseadvancedapproachestoenhanceoutcomes.
/ Relative to opportunity,theapplicantteam:
  • hasexpertisethat ishighlyrelevanttothe proposedresearchbothintermsofitsdepthand/orbreadth.
  • hasoverthelast 5 years,acombinedrecordofresearchachievement that is excellent by international standards commensurate with their field of research.
•research achievement may include contributions to translational outcomes such as patents, commercial outputs, and public policy or implementation of change in practice
•research quality as exemplified in the top 5 publications of each CI
•research productivity as exemplified by total outputs for the team
  • hassenior memberswithexcellentnationaland/orinternationalreputationsinthefield ofresearch relevanttotheapplication.
  • may involvejuniormemberswhoarestrong contributors tothe overallteamqualitycapabilityorwillhave the capacityto doso duetotheavailabilityofstrongmentoring.

5VeryGood / Theproposalhasa researchplanthat:
  • isgenerallyclearinitsscientificplanandislogical.
  • raisesonlyafewminorconcernswithrespecttothestudydesign.
  • isfeasibleinall,or almostallareas-requiredtechniquesandtoolseitherestablishedor nearlyestablished.
  • maynotbehighlycompetitivewithsimilar researchproposalsinternationally.
/ Theplannedresearch:
  • willadvanceknowledgeinthisfieldwhichaddressesanissue ofimportanceto humanhealth.
  • mayresultinfundamentaloutcomesinthescienceunderpinninghumanhealthissues.
  • will provide outcomes that represent good value for money with very few concerns regarding feasibility
  • maytranslateintofundamentaloutcomesinthepractice ofclinicalmedicine,publichealth orinhealth policy.
  • couldbethesubjectofinvitedplenarypresentationsatinternationalandnationalmeetings.
  • islikelytoresultinsomeverystrongpublications.
  • isinnovativeinconcept.
  • willusewellestablishedapproachestogoodeffect.
/ Relative to opportunity,theapplicantteam:
  • raisesonlyminorconcernsregarding the depthand/or breadthofexpertiserelevanttotheproposedresearch.
  • hasoverthelast 5 years,acombinedrecordofresearchachievement that is well above by international standards commensurate with their field of research
•research achievement may include contributions to translational outcomes such as patents, commercial outputs, and public policy or implementation of change in practice
•research quality as exemplified in the top 5 publications of each CI
•research productivity as exemplified by total outputs for the team
  • membershaveverygood andgrowingnationaland/or internationalreputationsinthefield ofresearch relevanttotheapplication.
  • may involvejuniormemberswhoare valuablecontributorstotheteamqualitycapabilityorwillhave the capacityto doso duetotheavailabilityofsomementoring.

4 Good / The proposal has a research plan that:
  • isgenerally solid in its scientific plan, but may not always be clear in its intent and may lack some focus.
  • raisesseveral minor concerns regarding the study design.
  • raisesdoubts about the feasibility in some areas.
  • is not likely to be competitive with similar research proposals internationally.
/ The planned research:
  • mayincrementally advance knowledge in the field which addresses an issue of some importance to human health.
  • isunlikely to result in fundamental outcomes in the science underpinning human health issues.
  • will provide outcomes that represent some value for money with several minor concerns regarding feasibility
  • isunlikely to translate into fundamental outcomes in the practice of clinical medicine, public health or in health policy.
  • isunlikely to be the subject of invited plenary presentations at international meetings.
  • may result in some good but not excellent publications.
  • is solid in concept.
  • will in the main use standard approaches.
/ Relative to opportunity, the applicant team:
  • raisessome significant concerns regarding the depth and/or breadth of expertise relevant to the proposed research.
  • has, over the last 5 years, a combined record of research achievement that is average by international standards commensurate with their field of research
•research achievement may include contributions to translational outcomes such as patents, commercial outputs, and public policy or implementation of change in practice
•research quality as exemplified in the top 5 publications of each CI
•research productivity as exemplified by total outputs for the team
  • members have good and growing national and/or international reputations in the field of research relevant to the application.
  • may involve some junior members who would have the potential to add to the team with mentoring, but there is little or no evidence of a mentoring framework to support them.

3 Marginal / The proposal has a research plan that:
  • issomewhat unclear in its scientific approach and goals.
  • containssome major design flaws.
  • raisesmajor concerns about the feasibility and thus the likelihood of successful completion.
/ The planned research:
  • addresses an issue of some importance to human health.
  • may result in some publications.
  • may have some innovative and novel aspects, while others underpin or extend existing knowledge.
/ Relative to opportunity, the applicant team:
  • members have made contributions to the field of research but there aresignificant concerns regarding the depth and breadth of relevant expertise.
  • has over the last 5 years, a combined record of research achievement quality (as exemplified by the top 5 publications of each CI) and productivity (totality of outputs) and/or translation into practice, that places them at an average level for their peers/cohort.
  • members have established national reputations but do not yet have strong international profiles.

2
Unsatisfactory / The proposal has a research plan that:
  • isunclear in its scientific approach and goals.
  • containsseveral major study design flaws.
  • raisesseveral major concerns about the feasibility and thus the likelihood of successful completion.
/ The planned research:
  • addresses an issue of some concern to human health.
  • provides a program of research which will not significantly advance current knowledge in the field.
  • has relatively little innovation or novelty.
/ Relative to opportunity, the applicant team:
  • isdeficient in some areas of expertise that will be required to successfully complete the proposed research.
  • has published only a few works in relevant and other fields of research.
  • members are not well known nationally or internationally in the relevant research fields.

1 Poor / The proposal has a research plan that:
  • contains a research plan which does not seem to be feasible.
  • isunlikely to be successfully completed.
/ The planned research:
  • doesnot address an issue of more than marginal concern to human health.
  • willnot advance current knowledge in the field.
  • only follows behind previously well documented and studied concepts or previously well used approaches.
/ Relative to opportunity, the applicant team:
  • is heavily underpowered in terms of relevant expertise required to successfully complete the research program.
  • isnot productive to any significant extent in relevant fields.
  • members are not well known nationally or internationally in the relevant research fields.

NHMRC PG 2018 (for funding commencing in 2019)