The Edward J. Stemmler, M.D. Medical Education Research Grant Program
2025 Funding Cycle: Letter of Intent
Submission Content and Formatting Guidelines
Purpose and Mission
The goal of the Stemmler Grant Program is to provide support for, research on, and development of pioneering assessment approaches that will enhance the professional development of those preparing to, or continuing to, practice medicine through funding medical education and assessment communities to drive future innovation.
The Stemmler grants serve as an extension of the NBME’s dedication to its mission: “...to protect the health of the public through state-of-the-art assessment of health professionals” and its commitment to support assessment-related research and development conducted by medical school faculty. The grant program is not intended to fund projects designed to develop commercialized assessment products and services and will not consider any such proposals for funding.
Expected outcomes of funded projects include innovative advances in the theory, knowledge, or practice of assessment at any point along the continuum of medical education and practice. Both pilot projects and more comprehensive efforts are of interest. Collaborative investigations within or among institutions are encouraged.
Eligibility Requirements
Open Science Principles: The Stemmler Grant Program is linked to NBME’s mission to serve the public. As such, it is expected that investigators abide by Open Science Principles in data sharing and reporting. If you are unable to follow these principles, please include rationale in your materials for review by the Stemmler Grant Committee. In the absence of a compelling rationale, preference will be given to proposals who agree to follow Open Science Principles (see http://opendefinition.org).
Investigator Team: Each project team must include an early career investigator mentored by the principal investigator and other team members. The intent is for the junior member of the team to make substantive contributions to the project, and thereby gain a broader understanding of medical education and assessment research.
Institutional Proposals: The Stemmler Committee will accept multiple LOIs from a single institution. However, they will only invite a maximum of one LOI per institution to submit a full proposal.
Letter of Intent
Requirements: The Letter of Intent (LOI) must follow the format below to provide a structured and succinct overview of your research that supports the mission of the Stemmler Grant Program. The document should contain no more than 1,500 words (sections 1-3), double spaced with no smaller than 10-point font. (Note: Section 4 and the Required Supplement are additional components with separate word counts.) You may include up to two appendices if they are critical to understanding your research; these will not be included in the word count. Videos, website links, and other forms of media are acceptable forms of appendices.
Submission Components:
Section 1: Study Purpose and Research Objectives
Include a concise statement describing the research project's fundamental purpose and the specific research problem(s) that will be addressed. The purpose statement should be followed by one or more research questions, one or more hypotheses to be tested, or the specific project objectives and deliverables.
The following is an example of a purpose statement and research questions from a prior project. It is not necessary that you follow this same format, but your statements should be similarly concise and explicit.
The purpose of this research is to determine whether a case diagramming technique can be used to assess students’ clinical reasoning with respect to the concepts taught in an integrated course on mechanisms of disease. Two research questions will be addressed:
- Are scores based on a case-diagramming tool sufficiently reliable for classroom use?
- Do scores on the case diagramming tool measure clinical reasoning more effectively than standard multiple-choice questions?
Section 2: Background and Rationale
This section should consist of two parts: (1) a brief literature review that situates the research within current knowledge. This should place the research project in the context of appropriate literature and cited challenges in medical education assessment; and (2) a description of how this research is innovative and how it has the potential to impact assessment in medical education. A list of up to 10 references can be included in this section. References are excluded from the word count.
Section 3: Design, Methods, and Analysis
Clearly describe and justify each portion of the overall study design including, as appropriate, the study participants, assessment or measurement procedures, data collection methods, and the analytic procedures used to address each research question listed in Section 1. This section should also include the theoretical framework and constructs for the analyses and any validity and reliability arguments supporting the methods.
Sections 1-3 should total no more than 1500 words.
Section 4: Response to Previous Reviewer Feedback (If Appropriate)
If you have submitted your LOI in a previous cycle and received feedback from the Stemmler Committee, please address the points as a supplement at the beginning or as part of the main sections of your LOI. We ask that you note the cycle year of the original submission. You may use up to an additional 300 words beyond the 1,500-word limit for this section.
Required Supplement: Roles of Research Team Members
In no more than 1 page per person, identify the individuals who will be filling the following roles on the project:
- Primary Investigator
- Methodologist/Assessment Specialist
- Mentored Early Career Investigator (see above for description)
Include these individuals’ affiliations, qualifications for their role, and anticipated time on the project (e.g., total hours or hours per month).
In no more than 1 page per person, please describe each additional research team member’s (including any proposed consultants) qualifications for and contributions to the project. This should include the following:
- Name and Degree
- Institutional Affiliation and Title/Position
- Role on and contribution to the Project (including anticipated time on the project)
- A paragraph describing their qualifications for the project/role
This section does not count toward the 1500-word limit.
Please refer to Submitting Your Completed LOI (below) regarding anonymization.
Letters of reference or character are not required. Please do not include them with your submission.
Submitting Your Completed Letter of Intent
Formatting an Anonymized Copy:
All documents for upload should be in PDF format and combined to be submitted as one document. You are required to submit two copies of the LOI to the Submittable site: one that is fully identified and one that is anonymized.
Anonymized versions should omit any identifying names of individuals and institutions (including such information as affiliations or region).
Other than the required redactions, please be sure that the anonymized version is identical to the fully identified version, including all necessary LOI components.
Submittable:
The Stemmler Grant Program utilizes the platform Submittable for all submissions. You may access our account here: https://nbme.submittable.com/login. If you have not used Submittable before, please create an account to access our page and complete the submission process: https://nbme.submittable.com/signup.
Note: If you have previously used the Stemmler Grant Program’s online submission platform outside of Submittable, your submissions were connected to the user email address on file. Your submissions will appear on your dashboard labeled with the title of your submission and previous submission ID number.
Submission Deadline:
All submissions are due by Monday, July 17, 2024, at 11:59 p.m. (Eastern US).
Thank you for your interest in the Stemmler Medical Education Research Grant Program.
If you have any questions or concerns, please feel free to email stemmlerfund@nbme.org
Presentations are approved in two phases:
- Proposal / Abstract Approval (This Form) - This is the initial proposal, abstract, and/or related data used for submitting to conferences.
- Full Presentation Approval (Additional Form Sent Later) - This is the final version that you will be presenting, including any papers, slides, etc..
This form will be used for Presentation Proposal / Abstract Approvals. To upload your full presentation, an additional form will be sent to you to complete at your leisure. A notification will be sent 3 weeks prior to your conference date as a reminder to upload your materials if not already completed.
Proposal / Abstract Approval Timelines
Please budget about 2 weeks for the initial review process.
- VPs, Program Owners, and/or other reviewers complete their reviews within one week of assignment.
- The presentation is assigned to an SVP for final review and approval. The final review and approval is due within one week of assignment.
- The review decision is communicated to the submitter via email from submittable@nbme.org and will include any comments from the submission review process.
Full Presentation Approval Timelines
An additional form will be sent to you to complete at your leisure once your initial proposal has been accepted. A reminder will be sent three weeks prior to your conference date to upload your final materials if not yet completed.
For full presentations uploaded via the additional form, please budget at least 2 weeks for a full paper presentation, and 1 week for slide presentations.
Collaborate on Your Submission! If you wish to collaborate with others on this form, click on 'Invite Collaborators' on the top right of the form. You can then assign a collaborator via email invitation and work together in real-time or save a draft for later completion. If you are a Collaborator on this form, please click on Save Draft when you have finished entering responses. The initiating submitter will then be able to review and submit the form. At this time, only the initial submitter has the ability to submit the presentation or publication in the system for review & approval.
Please budget about 2 weeks for the publication review process. We allow the VP & Programmatic Reviewer 1 week to review and approve the submission prior to it being assigned to a SVP Reviewer. The SVP Reviewer has 1 week to review and provide the final decision on the submission.
If a time-sensitive decision is needed, please contact the Office of Research Strategy Staff immediately at ORS@nbme.org so we may assist in expediting the process.
Collaborate on Your Submission! If you wish to collaborate with others on this form, click on 'Invite Collaborators' on the top right of the form. You can then assign a collaborator via email invitation and work together in real-time or save a draft for later completion. If you are a Collaborator on this form, please click on Save Draft when you have finished entering responses. The initiating submitter will then be able to review and submit the form. At this time, only the initial submitter has the ability to submit the presentation or publication in the system for review & approval.
NBME Philanthropy Funding Application
For years, NBME has been vested in philanthropic giving and contributions, sponsoring several initiatives which support our mission and advance the field of assessment science. Initiatives include the Stemmler Fund, Latin America Grants and Strategic Educators Enhancement Fund (SEEF).
In 2022, NBME developed a philanthropy strategy focusing on four target areas for our giving. NBME’s philanthropy strategy target areas over the next few years will:
- Advance assessment and medical education research;
- Provide resources to fortify the success of traditionally underserved learners;
- Support capacity building and resources for pathway (pipeline) programs to impact diversity, equity, and inclusion in the medical and assessment professions; and
- Give locally to organizations that advance health equity and access and other social determinants of health to strengthen health outcomes for Philadelphia communities.
Philanthropic Giving
Our giving and grantmaking will be to organizations advancing the above priorities
Current policy: In 2018 NBME adopted a policy regarding donations, Discretionary Charitable Giving Policy, which governs discretionary giving by the organization. Under the policy, requests for discretionary giving are made to the Philanthropy Office with review by Legal Services and written approval provided by the Senior Vice President, Office of General Counsel and Organizational Affairs. Any charitable giving over $5,000 must be approved by the President.