Specifically designated Local Site Leaders will bear responsibility for performing First-Level QA on OSRIs as they are completed by reviewers. In order to accurately perform First-Level QA, the site leader should complete both an initial review and an in-depth review.
The initial review is an opportunity for the site leader to become familiar with the case and quickly review the instrument. Follow these steps to complete your initial review:
- Confirm Completeness and Preliminary QA. Before you transfer a case to begin First-Level QA, make sure the case is complete by checking the Completeness column. Also verify with the review pair that they have completed Preliminary QA on the case.
- Transfer the case. You will need to transfer the case to your tablet to conduct First-Level QA. Before transferring a case, ensure that the reviewers have changed the case's QA Status to "Ready for QA Review." Also remember that after you transfer a case, reviewers will be able to access the case but not edit it until you have returned the case to them. JBS technical support staff on site will assist you in your first transfer, which you will find to be a very simple process.
- Check sample appropriateness. Use the Case Elimination Guidelines located on the ACF website, to make sure that the case belongs in the sample. If, after review, it appears that the case does not belong, you may need to consult with the NRT Local Site Leader about eliminating it from the sample.
- Add stickies where necessary. As you begin to review the case, add stickies to any questions that need correction, clarification, or additional information.
- Gain a basic understanding of the case. You’ll want to start to gain a basic understanding of the case as quickly as possible. Different site leaders employ different strategies for learning about the case details. One particularly effective strategy is to scan the Face Sheet, items 1–4 of the instrument, item 7, and item 17. Site leaders will go back over each of these items in more detail later in the QA process; however, if reviewers have appropriately completed these items, they should provide a basic overview of the case.
- Take basic notes. Site Leaders have also found it useful to begin taking notes from the Face Sheet at this time. Noting some basic information, such as the age of the target child or the ages of the children in the home and the date that the case was opened for services, can help the site leader get an overview of the case and prepares them for reviewing missing information.
- Identify missing information. Next, you’ll quickly review the case for missing information. The Combined QA Tip Sheet, particularly the sections that provide information on general errors in the body of the instrument and the Face Sheet, should be your guide.
Once you’ve completed the initial review of the case, you should begin reading through the case more carefully, paying special attention to the Rating Documentation for each item and using the item-specific errors and correlations section of the Combined QA Tip Sheet.Use the following steps to complete your in-depth review of the case:
- Examine Main Reason statements. Each Main Reason statement should be clear, concise, focused. Each statement should address only the issue being assessed in the item. It must also be consistent with the item’s rating and should contain enough information to fully explain or justify the rating.
- Check exploratory questions. Some of the information needed to fully explain the rating is covered in the follow-up questions, and you need to make sure that they have all been addressed fully and adequately in their Main Reason statement.
- Check for sources. You should also ensure that the Main Reason statement indicates the source or sources of the information—for example, the case record or an interview with parents. Again, the QA Tips should be used to help you here.
- Check for consistency throughout. Also note that there should be no contradictory information between items throughout an instrument. The QA Tips should be used to ensure that you have reviewed each case for discrepancies in the information provided from one item to another. For example, the Face Sheet might list three siblings of a targeted foster child, but the later items, such as items 12 and 13, might reference only two siblings. Also, item 17 might reference two fathers, but item 19 might reference only one. Inconsistency across items can be the most difficult and time consuming to identify.
- Transfer back to Reviewers. Once you have completely reviewed the case and added the necessary stickies throughout, you should change the case's QA status to "QA Review Complete" and then transfer the case back to the reviewers so that they can begin addressing your comments.
- Resolve Stickies. Once the review pair has finished addressing your comments, they will inform you that it is ready, and you will again transfer it to your tablet. At this point, you will review the stickies you added. If further changes are necessary, you can add to the sticky and send it back for further correction or meet with the review pair in person to discuss the problem. If the sticky was adequately addressed, you should resolve it to remove it from the list.
Once all of its stickies have been resolved, the case is ready to move on to Second-Level QA.