Research Analysts working in the Department of Children and Families are responsible for statistically modeling determinants and predictors that protect children, strengthen families and build communities.
Research Analyst – Advanced
Department of Children and Families
Division of Management Services
Bureau of Performance Management
Quality Review and Performance Analysis Section
Position Summary: Under the general supervision of the Performance Analysis Unit Supervisor in the Bureau of Performance Management, the CQI Analyst is a technical expert who designs, develops, and performs complex research and program evaluation that requires statistical and analytic skills. The position works independently to ensure the fulfillment of the department’s mission and goals to promote the economic and social well-being of Wisconsin’s children and families.
The position collaborates with other researchers, management, division teams, and partners such as counties, contractors, academic, and research institutions. The position leads the development of the scope, research methods, content, quality measures, analytical reports and communications directed internally and to the public of internally initiated research and evaluation projects. This position conducts research and advanced analytics related to Wisconsin’s child welfare Continuous Quality Improvement case reviews and improvement projects. The position provides analytical technical expertise to evaluate internal and research and evaluation deliverables.
Goals and Activities:
50%. A. Lead the data collection, research and analysis efforts of WI Child Welfare Continuous Quality Improvement (CQI) case review process.
A1. Serve as the knowledge expert in sampling methodology and data analytics for CQI case review process. Provide expertise in data analysis design, tool development, and report development. Answer questions and provide technical assistance to staff within DCF and local county providers.
A2. Determine the availability, quality and limitations of data for CQI purposes and make recommendations on how to improve the availability and quality of data. Develop and implement plans for improving data quality.
A3. Ensure timely collection, accurate analysis and interpretation of qualitative and quantitative CQI performance data. Coordinate efforts with the Quality Review unit and case reviewers to improve data reliability.
A4. Utilize statistical software to identify representative case samples, prep case review data for analysis, evaluate and summarize findings, and conduct complex statistical analysis of data. Ensure that all processes are consistent and reliable.
A5. Contribute to the efforts to evaluate, institutionalize, continuously improve and expand the CQI case review data collection and analysis in collaboration with the Quality Review unit, the Research & Evaluation section and the Division of Safety & Permanence.
A6. Lead the process for working with division staff to identify essential information for CQI purposes. Determine priorities for new information and the costs and benefits of obtaining the information. Work with program and information technology staff to ensure the information is collected in division data systems and enhance data systems where necessary to collect essential information.
A7. Lead and participate in meetings and workgroups with colleagues and stakeholders to develop and update review tools, identify and test hypotheses, review results and edit reports.
A8. Establish and maintain strong knowledge of CQI case review tools. Work with CQI case review experts to keep up to date on changes. Participate on teams charged with designing and implementing case review tools to ensure validity and reliability of data. Serve as data lead on team to identify challenges with data collection and analysis.
A9. Provide project support by conducting root cause analysis, complex data analysis of child welfare data (administrative and case review) and other quantitative data (survey, focus group, targeted case reviews).
A10. Provide support to the Federal Child & Family Services Review (CFSR), including preparing data and specialized analyses, and providing analytical support to DCF’s Performance Improvement Plan as needed.
A11. Maintain awareness and conduct analysis of innovative child welfare service models and quality review methods in other states and assess the potential use of these models in Wisconsin. Work with divisions and county agencies to determine the potential use of these models in Wisconsin. Prepare briefing papers and make recommendations to management.
20% B. Effectively communicate complex information through a variety of modes to various internal & external audiences.
B1. Produce a variety of written deliverables detailing methods and findings of the CQI case review process, including reports, executive summaries, and briefing documents.
B2. Ensure that all written deliverables using complex qualitative and quantitative data from multiple sources communicate clear analysis, findings, and if appropriate, recommendations.
B3. Provide ad hoc performance data and analysis to the Department, the Division of Safety and Permanence, the Division of Milwaukee Child Protective Services, contract agencies and key constituencies in order to improve child welfare services and outcomes.
B4. Prepare options and recommendations to guide the Bureau, Division and Department through the development of policy.
B5. Assist in identifying conclusions and themes based on analysis results, prepare final results and review with program/policy staff.
B6. Support managers and executives in writing reports, preparing presentations and visualizing data.
B7. Review the preparation of reports and summaries of program evaluations and effectively communicate findings and results of conclusions to diverse audiences. Orally present data and findings to colleagues, county staff, and other stakeholders.
B8. Provide clear communication through reports and briefings on issues that affect department policy, research and performance management.
B9. Participate in technical and special committees, task forces, and study groups across the department.
B10. Maintain clear communication with supervisor.
20% C. Serve as a knowledge resource for the bureau and department managers on matters related to performance, research, program and policy evaluation. Prepare analytic information on matters related to Department-wide priority initiatives, conduct analysis and interpret data in support of the organization’s mission.
C1. Identify, analyze and evaluate emerging issues relating to programs and services provided by program divisions.
C2. Assist managers, executives and analysts in identifying, framing and researching analytic questions for other projects, including the Jeanine B. Settlement Agreement and KidStat.
C3. Work with existing department administrative databases to analyze, interpret and present data (e.g. eWiSACWIS, CARES, KIDS, etc.).
C4. Support the design and analytical processes for bureau research to answer evaluation questions which may include merging and manipulating data tables, data cleansing and data testing.
C5. Conduct short-term, quick turnaround data analytics projects in response to questions posed by the executive team, department managers and program staff.
C6. Develop a variety of deliverables to be utilized by executive management such as action plans, dashboards, performance reports and other work products as needed.
C7. Effectively prioritize analytic needs based on competing priorities developing timelines and plans as needed.
C8. Ensure accurate and clear graphical representations of data for the purpose of performance review.
C9. Ensure integrity, accuracy and suitability of available data for answering research questions.
C10. Provide project management support for research and evaluation efforts.
10% D. Other research activities as assigned.
Knowledge, Skills and Abilities:
1. Extensive knowledge of the principles and practices of social/behavioral research.
2. Extensive experience working with both quantitative and qualitative data.
3. Extensive experience and skill in designing and completing descriptive statistical analyses such as frequency, mode, median, average, cross-tabulations among variables, etc.
4. Thorough knowledge of research design and methodology, including survey research, sampling methods and design, and program and policy evaluation.
5. Considerable experience with and knowledge of advanced statistical methods such as regression analysis, establishing correlations, etc.
6. Proficient level of skill in utilizing and understanding data mining concepts.
7. Ability to analyze incomplete information, identify limitations, evaluate alternatives and make appropriate recommendations for strategic solutions.
8. High level of skill in spreadsheet and database management software Microsoft Excel (including pivot tables) and Access.
9. Advanced knowledge of statistical management software such as SAS or similar programs.
10. Expert skill in writing research and technical reports that are factual and unbiased, that address important programmatic questions, and that are accessible to a nontechnical and general audience.
11. Extensive skills in developing and maintaining effective working relationships with management and professional staff throughout the department including the Secretary’s Office.
12. Strong oral communication with management and professional staff including informal conversations and formal briefings of research.
13. High level of skill in negotiating agreements and developing compromise among diverse and often conflicting opinions.
14. High level of skill in effective project management tools and techniques including the coordination and implementation of complex, department-wide projects and research projects.
15. Extensive knowledge of performance management principles and strategies.
16. Knowledge of continuous quality improvement tools and techniques, such as Lean Six Sigma.
17. Knowledge of federal and state laws and regulations applicable to Department programs.
18. Knowledge of social services programs serving children and families, particularly child welfare, including knowledge of child welfare program laws and regulations and considerable knowledge of social work principles and practices in the field of child protective services.
19. Knowledge of Department data systems including but not limited to: CARES, KIDS, eWiSACWIS, etc.