The NAOME Review Panel will be selected largely from a reviewers' pool consisting of Fellows in NAOME. Until the NAOME Fellow numbers reach the necessary number for the review panel, additional members of the Review Panel will be selected from a pool of reviewers designated as educational leaders from each COM and representing the educational impact categories of the applicants.
Using protocols of the National Institutes of Health, a primary and secondary reviewer will be designated for each submission. These reviewers will propose initial ratings for all criteria, lead the discussion of the applicant's materials during the review meeting, and help write brief critiques in support of selection decisions.
After the review panel discussion of each candidate, each member of the Review Panel (having reviewed each mini-portfolio in advance) will assign up to 100 points to each portfolio based on how well the mini-portfolio matches the standards for a given awards category, as represented by the standard-setting mini-portfolio samples provided (see Mini-Portfolio Preparation).
To receive an award, the average number of points assigned by Review Panel members must meet or exceed the established cutoff of 80 points, and 75 percent of the Review Panel members must give a score of 80 or higher. Panelists will assume that the standard-setting mini-portfolio examples would receive an average of 85 to 95 points.
The process primary and secondary reviewers will use in assigning points will be subdivided into three criteria as illustrated below for the teaching/learning category (see point assignments for other categories with category description):