Item Ratings and Rating Documentation

Each OSRI item is rated automatically by the application once all of its questions are answered and its Calculated Rating is shown on the Save Bar. The exception to this is the Face Sheet, which is unrated. There are four possible ratings for each item:

  • Incomplete (questions remain unanswered)
  • NA (Not Applicable)
  • Strength
  • ANI (Area Needing Improvement)

If an item has been overridden, a double asterisk (**) will appear beside the rating. If you float the cursor over the rating, you will be able to view the override.

Once an item has been rated, the reviewer must complete that item’s Rating Documentation. This documentation is entered on the Rating Documentation Screen, which is accessed by clicking the Save>Rating Documentation button on the Save Bar.

The Rating Documentation Screen is laid out in the same format as every other OSRI screen, with two exceptions: the Purpose of Assessment is replaced by the Reason for Rating and the Save>Rating Documentation button is replaced by the Save>Item Questions button. Clicking this button returns you to the regular OSRI screen.

Answering Rating Documentation Questions

The first question on each Rating Documentation Screen is referred to as the Main Reason Statement, and it is where the review pair must provide the main justification for the item’s Calculated Rating. There are certain formatting and content issues that you must keep in mind when composing your Main Reason Statement; see Module 3.3.1: Writing the Main Reason Statement for more information. The same is true for the follow-up questions that come after the Main Reason Statement.

Remember that when you are completing the automated instrument, every question must have an answer. If you answer one of the follow-up questions in the Main Reason Statement, you must enter text in the follow-up question to indicate this. For example, you might type "See Main Reason" or "Answered in Main Reason." If a follow-up question is Not Applicable to the case, then you must type the letters "NA" as an answer. You cannot leave any questions blank.

Also, note that there is no need to complete the Rating Documentation immediately. A review pair may choose to finish the Rating Documentation after they answer all of the OSRI’s questions, or they may complete each item’s Rating Documentation as they complete each item. Work through the instrument in the manner you find most efficient.

Overriding Item Ratings

There are times when a review pair may disagree with the rating that the automated application assigns to an item or outcome. In these cases, the system does allow for any item’s Rating to be overridden and changed. Note that review pairs can only suggest that a Rating be overridden; only Site Leaders can actually perform an override.

If a review pair believes that an item’s rating should be changed, they should indicate this in the Main Reason question on that item’s Rating Documentation Screen. Local Site Leaders will review these answers during First-Level QA and decide whether overriding the item’s rating is justified.

If an override is justifiable, then the Site Leader can use the Override button. The Override button can only be accessed through the Screen View. To override an item’s Rating, use the following steps:

  1. Navigate to the appropriate item. Click the Override button, which is located in the middle of the Save Bar.
  2. The Item Rating Override Window will open. The field at the top of the window displays the item’s current Rating. Beneath that is the Select Override Rating drop-down menu. Use this menu to select the new item rating.
  3. Enter the reason for the item rating override in the text area of the Item Rating Override Window. When you are finished, click the Save and Close button.
  4. The item’s original Calculated Rating will still display in the Save Bar. However, two asterisks (**) will display beside it to indicate that it has been overridden, and if you float the cursor over the rating a pop-up window will display both the new rating and the reason for the override.

You can further edit an item’s rating or the reasons for overriding it by clicking the Override button to reopen the Item Rating Override Window. Repeat the steps described above to make any changes.

Note that you can undo an item rating override by clicking the Undo Existing Override button, which is located beside the Save and Close button. Clicking this button will open a pop-up window asking you to confirm your selection. Click the Yes button to proceed with the undo, or the No button to cancel.

Once an override has been undone, the Item Rating Override Window will close. The item’s Calculated Rating will be returned to what it had been originally, and the asterisks marking the override will no longer be present.