Rethink Integration:
Creating new audits at 9:00 AM each morning
Audit creation should be completed within 1-2 hours
Suggested Workflow:
Review audits on a daily basis
One member of your team to review 97153 notes
Under filter, select 97153 under the Question Set
Also select “Not Reviewed” under the review status filter
Begin reviewing audits that were not reviewed until you work through all audits
Repeat process each day
One member of your team to review 97155 notes
Under filter, select 97153 under the Question Set
Also select “Not Reviewed” under the review status filter
Begin reviewing audits that were not reviewed until you work through all audits
As you’re reviewing each of these audits, be sure to select “Mark Reviewed”. This way you will have an end point for the next day’s list of audits that are created
Reviewing Audit Results:
When selecting an audit for review, you’ll first be presented with the questions that failed
You can select the magnifying glass to show the context behind why we answered the question the way that we did
You can then review the session note shown on the left-hand side of the screen to review the note and determine if the answer was answered correctly
If not, please see the Feedback section below, and change the answer by double-clicking the answer to correct the system
This will then recalculate the audit score and notify our team of an answer change
If corrections/feedback need to be given to the provider, select the purple email button to send an instant email to the provider
An email will then be generated with the necessary feedback based on the audit results.
Please reach out to [email protected] if new email templates are needed or if information need to be changed. We can hold a subsequent training call
Feedback:
If a question is answered incorrectly, the best way to keep track of all feedback across your organization is to leave the feedback on the question and specific audit that is being reviewed.
On each audit, if we answer the question incorrectly, select the comment icon next to the listed question
Once selected, a new window will open which will show the question, answer, and context behind our answer. You can also select a sentiment (thumbs down - negative/thumbs up - positive), and a comment box
Please be sure to give as much information to why the question was answered incorrectly. This will allow our team to immediately start working on this feedback without any need for clarification.
Brellium's feedback console is now available. This will allow you to track feedback and for admins to prioritize/deprioritize requests. Please reach out to [email protected] for more information and set up.
Additional Information:
Question Studio:
Question Studio is where you can find both of your question sets
You can filter by individual question sets and make overall changes to your audit structure
Under the severity column you’ll be able to see the overall impact a given question will have to your audit scores.
If you see one question failing consistently, but you don’t want to have as high of an impact, you can edit the question using the note pad icon and selecting a different severity from the dropdown menu
You can also select and add new audit flags to individual questions.
If this question fails, this audit flag will automatically be shown under the audit results tab making it much easier to know what needs review without clicking into individual audits:
Scheduled emails:
Instant emails were outlined above, but we can also schedule weekly emails to send to providers/BCBAs that will compile all feedback into one email for their review
This cuts down on the number of emails being sent to providers/BCBAs, and allows your team to have a weekly synopsis of feedback for each provider/BCBA
Reach out to [email protected] for help setting up the email schedules
Scheduled emails can be used for feedback on session notes as well as positive reinforcement
Most emails can be completely customizable and are an extremely useful tool to cut down on manual email reach out’s
Analytics:
Trend Data is included in your Brellium contract and is an extremely useful tool to review audit data across your organization
You can begin to review company averages overall, as well as provider averages
You can also begin to review data that is specific to individual questions which can inform your QA team on what questions are working well for your session notes, as well as what may need to be reworked
As a QA team/admin you can begin to utilize this information to celebrate your top performing providers, as well as reach out for some additional trainings with your providers that might be having some trouble raising their overall scores.
Our customers have found that a bi-monthly review of trend data allows you to track results and valuable insights for your QA team.