Ratings

There are two types of ratings in the OSRIitem ratings and outcome ratings. The item ratings feed into the outcome ratings, so that once reviewers have completed all of an outcome's items, that outcome receives its own distinct rating. Once all seven outcomes and 23 corresponding items in the instrument have received a rating, and rating documentation has been completed, the instrument is considered finished and should be finalized.

Item Ratings

Each item in the OSRI, with the exception of the Face Sheet, receives a rating once its questions are addressed. There are three possible ratings:

  • Strength
  • Area Needing Improvement (ANI)
  • Not Applicable (NA).

During the first round of reviews, reviewers were responsible for deciding which rating each item should receive. Now, with the automated system, item ratings are calculated automatically by the system based on the answers to each item question. If each of the questions under each item is answered appropriately and correctly, the rating that the automated system assigns to the item will also be appropriate and correct. Therefore, it is the responsibility of the reviewer to answer the questions correctly, so that the automated system can assign correct ratings for the items.

Note that if you answer all of the questions appropriately, but don’t agree with the system's automatic rating, there is a mechanism that allows site leaders to override the rating. This is a very rare occurrence, though. In most cases where there is a discrepancy between an item's automatically generated rating and the rating you expect it to have, the discrepancy is due to an incomplete or inacurate answer on one or more of the item questions. Review your answers carefully for errors!

Outcome Ratings

The automated application automatically calculates and rates the outcomes once all that outcome's items have been rated. There are four possible outcome ratings:

  • Substantially Achieved: The required number of applicable items are rated as strengths.
  • Partially Achieved: Some applicable items are rated as strengths, but the number does not meet the level required for the outcome to be rated as substantially achieved.
  • Not Achieved: None of the applicable items is rated as a strength.
  • Not Applicable: None of the items is applicable.

To rate an outcome as substantially achieved, the following criteria must be met:

  • Safety Outcome 1 and Safety Outcome 2: All applicable items must be rated as strengths. Items rated not applicable are disregarded.
  • Permanency Outcome 1: Item 7 and the corresponding item  (8, 9, or 10) rated for the case must be rated as strengths. If the State is using concurrent planning and the reviewer rated two corresponding items, they must both be strengths. No more than one of either items 5 or 6 (if applicable) may be rated as an area needing improvement. Items rated not applicable are disregarded. 
  • Permanency Outcome 2: No more than one of the applicable items for this outcome is rated as an area needing improvement. Items rated not applicable are disregarded.
  • Well-Being Outcome 1: Item 17 must be rated as a strength. No more than one of the remaining applicable items may be rated as an area needing improvement. Items rated not applicable are disregarded.
  • Well-Being Outcome 2: Item 21 is rated as a strength.
  • Well-Being Outcome 3: All applicable items are rated as strengths. Items rated not applicable are disregarded.

Note that, while item ratings are included in the automated application, outcome ratings are not listed in the normal view. To review outcome ratings, use the Preliminary Case Summary Report.