Keystone STARS Technical Assistance Accountability Plan (STARS-TAAP) Benchmarks
BenchmarkRange
Measurable Impact on Provider (Effect)
(There is an expectation that all types of technical assistance will have some influence on the measurable change of a program. Change affected may be in knowledge, skills, attitudes or behaviors in the target population. Action plan goals should address program changes that are expected as a result of the implemented action steps.) / STAR level change (STARS TA only. STAR level change will not be measured for other types of TA) / PELICAN / Count for CLOSED-EVALUATED STARS TA requests if move up occurred within the evaluation period, and was at least one month after the Action Plan opened and not more than six months after the Action Plan was closed. / 100% CLOSED-EVALUATED plans reviewed between April 1 and March 31.[1]
33% move up a STAR Level
Achievement of specific standards/indicators as identified on TA Action Plan
Survey of program staff (paper, telephone, or electronic) / Can be assessed through a call or visit.
Technical Assistance Goal Achievement Follow-up Guidance and Questions is to be used when assessing this criteria
On-site STARS Management visit or STARS designation
Review Action Plan goals against standards achievement. All goals in PELICAN K2Q will be aligned to a standard.
Good, Better, Best document moving forward
ERS Scores change / Assessment of goal achievement will occur between 3 – 6 months after the TA Action Plan is closed.
Action Plan goals will be assessed as met/not met in PELICAN K2Q by Regional Key TA Manager in the CLOSED-EVALUATED process. / 100% CLOSED-EVALUATED plans reviewed between April 1 and March 31.
80% CLOSED-EVALUATED Action Plan must meet this criteria. [2]
Provider perception of the effectiveness of TA / Provider feedback/ Satisfaction survey / TheTechnical Assistance Provider Feedback form is distributed at the close of each TA Action Plan.
TheTA Provider Feedback Survey is a Survey Monkey. Regional Keys have access to filtered reports for their region. / 100% CLOSED plans
80% feel TA was “extremely useful” or “very useful”
80% indicate that TA helped meet expected goals.
Qualifications, Professional Development and Professionalism
(Consultants must demonstrate the appropriate qualifications, experience and knowledge to provide technical assistance in the Keystone STARS content areas. They must also demonstrate a commitment to ongoing professional development to stay current on trends, research and issues in the field) / Consultant* eligibility / Consultant file to include:
Job description
Resume
Evidence of education (degree & field of study)
Clearances (Child Abuse, Criminal History, FBI)
PQAS verification for TA
(Certified or Specialty Discipline) / On-site review of Consultant Files / 100% reviewed annually
(Initial year review is applied to all consultants providing TA; thereafter to new consultants only)
100% meet eligibility
Completion of required professional development and plan for ongoing professional development / Evidence of TA Core Series Completion.[3]
Professional development certificates indicating date, #hrs and content
Consultant completes and maintains Pennsylvania Core Competencies for Relationship Based Technical Assistance (self-assessment) including PD Plan. / On-site review of Consultant Files
or
Paper review of documentation submitted to Regional Key / TA Core Series.
100% new consultants reviewed annually
90% meet professional development requirement
TA Core Competencies/PD Plan (file review)
All consultants hired within past year and 10% of established, renewing consultants files are reviewed.
Demonstrates ongoing professional development in TA competency areas and competence in content areas addressed by Keystone STARS Standards / Evidence of continuing education/professional development
degree & field of study
professional development certificates (indicating date, #hrs and content)
transcripts, etc.
Professional Org. membership / On-site review of Consultant Files
or
Review of documentation submitted to Regional Key / Ongoing Professional Development
(36 hrs over 5 years or minimum of 7 hrs./yr.).
100% reviewed annually and 100% demonstrate ongoing PD at required hours
Demonstrates ethical and professional behavior including the adhering to confidentiality as well as addressing needs of client without personal bias of values, beliefs, prejudices and past experience. / Provider Feedback/ Satisfaction survey.
Timeliness of appointments, follow-up etc.
Appropriately prepared for consultation (e.g. materials, background research, dress)
Communication
Feedback / Technical Assistance Provider Feedback form is distributed at the close of each TA Action Plan.
Technical Assistance Provider Feedback Survey is a Survey Monkey. Regional Keys have access to filtered reports for their region.
On-site evaluation/ observation (optional) / 20% reviewed annually
Provider Feedback
80% of returned surveys indicate that timeliness, appropriateness, communication and feedback are excellent or good.
Reporting Obligations
(TA consultants and organizations must comply with reporting requirements as defined in contract terms and conditions) / Timeliness and accuracy of reports & invoices / Date reports & invoices are received on or before due date
Date stamp received
Reports, invoices, forms submitted are completed correctly
Calculations are correct
Hours of service correlate with hours billed / Monthly reports and invoices (paper/electronic)
PELICAN K2Q data entry / Reports & Invoices (Monthly)
90% on-time
90% accurate)
PELICAN K2Q data entry
(Quarterly)
90% on-time
90% accurate
Timely follow-up and completion of referral / Provider contacted within 5 days of receipt of referral
# of hrs/days TA provided for action plan
# days to written action plan
# plans closed
Consultant keeps appointments and follows through on tasks / Contact Log and/or Intake Log
Monthly/Quarterly analysis of PELICANK2Q STARS TA reports
Contact Logs
Provider Surveys / Initial Call = 5 business days of receipt
Random sample of requests reviewed and 90% meet
Action Plan Completion
Length and number of hours for Action Plan are consistent with individual TA program guidelines.
TA organization keeps file on each TA request / Case Notes to include:
MPI
TA request
Intake Log
Letter of Agreement (signed)
Progress Interaction logs
Action plan
Case note forms are complete / Review of Case Note files (in PELICAN K2Q). / 10% random sample of all requests (with open or closed plans) including at least 5 and no more than 10 files.
90% of files reviewed are complete
Participates in ongoing communication with Regional Key regarding request status and targets / Dates and notes of calls or meetings regarding:
Certification issues
case review
loads
targets / Phone Logs
Meeting notes
PELICAN / Minimum of (3) three contacts/quarter.
7/1/121 of 5
[1]STAR 4 and 4A do not count in the base when counting STAR movement.
[2]Total % of Goal Achievement should equal 80%.There is flexibility in how the 80% is determined to be met. Up to 10% may be justifiably exempt due to the following: certification referral, natural disaster or emergency, significant change in composition of program (e.g. more than 25% change in enrollment, adding age group, influx of new families, legal entity change, significant (50%) staff turnover,inability to reach provider to verify goals). STAR 4 and 4A facilities receiving technical assistance and maintaining STAR Level must be counted in Goal Achievement.
[3]STARS TAConsultants should show evidence of participation in practitioner STARS Core Series. Additional content to be defined, but may include Consultative Model, Developing Effective Action Plans, Beyond PDR 1 &2.Other types of TA should consult with their Regional Key to verify Professional Development requirements for consultants.
*For the purposes of TAAPS, the word consultant will include any person providing technical assistance (STARS TA, Infant Toddler Specialists, Child Care Health Consultants, SACC ASQ TA)