Evaluation Analyst, Health Systems Integration Initiatives

General statement of responsibilities

CAI, a nonprofit organization dedicated to building the capacity of leaders, workforce, and communities to innovate and translate research to practice that promotes health equity, is seeking a highly motivated professional skilled in mixed-methods evaluation, including qualitative and quantitative data collection and analysis, for the position of Evaluation Analyst. This is a full-time, ten-month long position; continuation will be contingent upon need and funding. The anticipated term of the position is March 2023-December 2023. The successful candidate will assist the Vice President of Research and Evaluation, Lead Evaluator – Health Systems Integration Initiatives, and individual Project Directors by using a mixed-methods evaluation approach to improve public health programming for substance use disorder and overdose prevention and to support evaluation of the Trauma Informed Care (TIC) portfolio. This position reports directly to the Lead Evaluator – Health Systems Integration Initiatives and is based in CAI’s NYC office.

Major tasks and responsibilities (include, but are not limited to)

  • Supports the design and facilitation of evaluation strategies for systems-level change, focused on leading the completion of deliverables for an evaluation strategy in partnership with the New Jersey Department of Health
  • Develops mixed-methods evaluation plans and tools including logic models, capacity and readiness assessments, needs assessments, surveys, focus group discussion guides, and interview guides
  • Implements project evaluation plans, including supporting data collection and cleaning for client-level and organizational-level data
  • Routinely analyzes quantitative and qualitative data to report on progress achieved towards deliverables included in the evaluation strategy for the New Jersey Department of Health
  • Conducts routine scientific literature reviews of best practices in evaluating health systems change initiatives, including trauma informed integration and approaches for overdose prevention, into health care delivery across a diverse array of clinics and other community programming
  • Completes other evaluation tasks, including preparing IRB protocols, data entry, preparing evaluation reports, drafting and submitting abstracts to conferences
  • Assists with templates and tools that present real-time data results using data visualization techniques
  • Perform various administrative duties including coordinating timelines, data entry, maintaining bibliographies, tracking the distribution of incentives, coordinating and scheduling meetings, and database and file management
  • Expected travel in New Jersey
  • Perform other duties as necessary/assigned

Minimum education, experience, and other required skills

  • Master’s degree in health/social sciences, public health, or comparable field
  • 1 to 2 years of full-time work experience in research and evaluation in a public health setting, preferably with experience in data and evaluation at the organizational-level or systems-level
  • Experience conducting mixed methods data collection through surveys, key informant interviews, and listening sessions
  • Knowledge of trauma informed care, substance use disorder, and overdose prevention
  • Strong database management, analysis and reporting skills (knowledge of the following preferred: Excel, MAXQDA, STATA, SPSS, REDCap, and Tableau)
  • Knowledge of data visualization and use of Tableau, Power BI
  • Strong attention to detail and adept at managing multiple projects and priorities

Physical Demands

These physical demands are representative of the physical requirements necessary for an employee to successfully perform the essential functions of the Evaluation Analyst’s job. Reasonable accommodation can be made to enable people with disabilities to perform the described essential functions of the Evaluation Analyst’s job.

While performing the Evaluation Analyst’s responsibilities, the employee is required to talk and hear. This position requires the employee to be on-site at a CAI office. The employee is often required to sit and work at a desk for prolonged periods of time and use their hands and fingers to handle or feel. The employee is occasionally required to stand, walk, reach with arms and hands, climb or balance, and stoop, kneel, crouch, or crawl. Must be able to lift up to 15 pounds at times. Vision abilities required by this job include close vision.

This job description is intended to convey information essential to understanding the scope of the Evaluation Analyst’s position and it is not intended to be an exhaustive list of skills, efforts, duties, responsibilities or working conditions associated with the position. Duties, responsibilities, and activities may change at any time with or without notice.

Other requirements

In keeping with CAI’s “safety first” approach during the COVID-19 epidemic, to ensure the health of our employees and the public whom we interact with, we are requiring all CAI employees to be fully vaccinated against COVID-19. New hires must show proof of at least one vaccine shot prior to their first day of work. (If someone is unable to obtain a vaccine due to a medical/disability or religious reason, they may contact CAI’s HR department; contact information will be provided as part of the interview process.)


The salary range for this position is $70,000- $75,000. CAI offers a generous benefits package including:

  • Medical, dental and vision insurance
  • Employee Assistance Program (EAP)
  • Flexible spending Account (FSA)
  • Dependent Care Account (DCA)
  • Transit Reimbursement Account
  • Life Insurance – company sponsored up to $50,000
  • Long term disability (LTD)
  • Short term disability (STD)
  • 401K retirement plan after three (3) months of employment
  • 401K company match of up to 3% of salary after the completion of one (1) year of service
  • Semi-monthly payroll, the 15th and last day of each month
  • Flexible and Hybrid work schedules
  • Vacation and Leave benefits:
    • 11 Holidays per year
    • 2 Personal days year
    • 12 Sick days per year
    • 10-15 Vacation days per year increasing after 4 years of service
    • 1 Cancer Screening Day per year
    • Bereavement Leave
    • Jury Duty Leave

How to apply

Apply online now. 

CAI is an equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status or any other characteristic protected by law.