First-Level QA

First-Level QA is the first quality assurance review of a case by a Local Site Leader. The specific steps involved in First-Level QA vary depending on your role.

First-Level QA for Reviewers

Reviewers who are going through the First-Level QA process will use the following steps:

  1. Change the status of the case: Before you can transfer your case to a Local Site Leader to begin First-Level QA, you must change its QA Status to "Ready for QA Review."
  2. Locate a site leader to transfer case: Once the QA Status has been changed, locate the appropriate site leader or his or her designee. The site leader will transfer the case to his or her tablet to conduct First-Level QA.
  3. Case becomes locked: Once the site leader transfers your case to his or her tablet, it will become inactive on your tablet and grayed-out in the Record Summary Grid. You can still navigate the case to access information or to prepare the Nightly Debriefing Report, but you will not be able to edit any information until the site leader returns the case to you.
  4. Receive case from site leader after review: When the site leader has finished conducting QA on the case, he or she will notify you and return the active case to your tablet.
  5. Refresh the Overview Screen: The first thing you’ll want to do when the case is transferred back to your tablet is refresh the Overview Screen. When the case refreshes, you’ll see that it no longer appears as dark gray. This means it’s now unlocked and can be edited normally again. In addition, the case’s QA Status will have been changed to “QA Review Complete.”
  6. Locate stickies: Now you will need to find the comments, or "stickies," left by the site leader. These are the application’s version of the actual sticky notes that were added to the instrument during the first round of reviews, when everything was done in hard copy. The Unresolved Comment Navigator makes this easy by displaying all comments and allowing you to jump immediately to any sticky note.
  7. Address each sticky: As you work through the stickies, be sure to address each problem indicated in the note, making any corrections or additions necessary. If you don't fully understand or agree with the comments in a sticky, be sure to discuss the issue with the site leader.
  8. Respond to each sticky: After you take all necessary steps to address a sticky, be sure to write a response. Your response might be as brief as "done" or "fixed," or, if necessary, it might briefly summarize the actions you took to address the issues raised by the sticky.
  9. Return case to site leader: When you've addressed the issues in every sticky and left a response for each one, you will return the case to the site leader so that he or she can review your changes and comments.
  10. Resolving stickies: Once the site leader is satisfied that the issue has been adequately addressed, he or she will mark the comment as resolved. When a comment is resolved, it disappears from the Unresolved Comment Navigator. If, however, the site leader determines that not all of the comments were appropriately addressed, he or she will return the case to you again. This process may continue, or he or she may discuss the issues with you face to face, until all comments are successfully resolved.

When all stickies are resolved, First-Level QA is complete and the case is ready for Second-Level QA.

First-Level QA for Site Leaders

Specifically designated Local Site Leaders will bear responsibility for performing First-Level QA on OSRIs as they are completed by reviewers. In order to accurately perform First-Level QA, the site leader should complete both an initial review and an in-depth review.

Initial Review

The initial review is an opportunity for the site leader to become familiar with the case and quickly review the instrument. Follow these steps to complete your initial review:

  1. Confirm Completeness and Preliminary QA. Before you transfer a case to begin First-Level QA, make sure the case is complete by checking the Completeness column. Also verify with the review pair that they have completed Preliminary QA on the case.
  2. Transfer the case. You will need to transfer the case to your tablet to conduct First-Level QA. Before transferring a case, ensure that the reviewers have changed the case's QA Status to "Ready for QA Review." Also remember that after you transfer a case, reviewers will be able to access the case but not edit it until you have returned the case to them. JBS technical support staff on site will assist you in your first transfer, which you will find to be a very simple process.
  3. Check sample appropriateness. Use the Case Elimination Guidelines located on the ACF website, to make sure that the case belongs in the sample. If, after review, it appears that the case does not belong, you may need to consult with the NRT Local Site Leader about eliminating it from the sample.
  4. Add stickies where necessary. As you begin to review the case, add stickies to any questions that need correction, clarification, or additional information.
  5. Gain a basic understanding of the case. You’ll want to start to gain a basic understanding of the case as quickly as possible. Different site leaders employ different strategies for learning about the case details. One particularly effective strategy is to scan the Face Sheet, items 1–4 of the instrument, item 7, and item 17. Site leaders will go back over each of these items in more detail later in the QA process; however, if reviewers have appropriately completed these items, they should provide a basic overview of the case.
  6. Take basic notes. Site Leaders have also found it useful to begin taking notes from the Face Sheet at this time. Noting some basic information, such as the age of the target child or the ages of the children in the home and the date that the case was opened for services, can help the site leader get an overview of the case and prepares them for reviewing missing information.
  7. Identify missing information. Next, you’ll quickly review the case for missing information. The Combined QA Tip Sheet, particularly the sections that provide information on general errors in the body of the instrument and the Face Sheet, should be your guide.

In-Depth Review

Once you’ve completed the initial review of the case, you should begin reading through the case more carefully, paying special attention to the Rating Documentation for each item and using the item-specific errors and correlations section of the Combined QA Tip Sheet.Use the following steps to complete your in-depth review of the case:

  1. Examine Main Reason statements. Each Main Reason statement should be clear, concise, focused. Each statement should address only the issue being assessed in the item. It must also be consistent with the item’s rating and should contain enough information to fully explain or justify the rating.
  2. Check exploratory questions. Some of the information needed to fully explain the rating is covered in the follow-up questions, and you need to make sure that they have all been addressed fully and adequately in their Main Reason statement.
  3. Check for sources. You should also ensure that the Main Reason statement indicates the source or sources of the information—for example, the case record or an interview with parents. Again, the QA Tips should be used to help you here.
  4. Check for consistency throughout. Also note that there should be no contradictory information between items throughout an instrument. The QA Tips should be used to ensure that you have reviewed each case for discrepancies in the information provided from one item to another. For example, the Face Sheet might list three siblings of a targeted foster child, but the later items, such as items 12 and 13, might reference only two siblings. Also, item 17 might reference two fathers, but item 19 might reference only one. Inconsistency across items can be the most difficult and time consuming to identify.
  5. Transfer back to Reviewers. Once you have completely reviewed the case and added the necessary stickies throughout, you should change the case's QA status to "QA Review Complete" and then transfer the case back to the reviewers so that they can begin addressing your comments.
  6. Resolve Stickies. Once the review pair has finished addressing your comments, they will inform you that it is ready, and you will again transfer it to your tablet. At this point, you will review the stickies you added. If further changes are necessary, you can add to the sticky and send it back for further correction or meet with the review pair in person to discuss the problem. If the sticky was adequately addressed, you should resolve it to remove it from the list.

Once all of its stickies have been resolved, the case is ready to move on to Second-Level QA.