Report 2012-122 Recommendation 17 Responses

Report 2012-122: Mental Health Services Act: The State's Oversight Has Provided Little Assurance of the Act's Effectiveness, and Some Counties Can Improve Measurement of Their Program Performance (Release Date: August 2013)

Recommendation #17 To: Health Care Services, Department of

To improve the quality of county processes related to measuring program performance, Health Care Services should use its performance contracts with counties to ensure that they identify meaningful data to measure the achievement of all their goals, set specific objectives, and require their program providers to capture those data so they can use the data to verify and report the effectiveness of their MHSA programs.

Agency Response*

The FY 2014-15 Performance Contract contains language specifying that counties must: report required data for the purpose of evaluating mental health outcomes; include reports on the achievement of performance outcomes in their three-year program and expenditure plan and annual updates; and, must include the performance goals from the three-year program and expenditure plan and annual updates in contracts with providers.

  • Response Type†: 1-Year
  • Completion Date: July 2014
  • Response Date: August 2014

California State Auditor's Assessment of Status: Fully Implemented


Agency Response*

The Performance Contract contains language specifying that counties must: report required data for the purpose of evaluating mental health outcomes; include reports on the achievement of performance outcomes in their three-year program and expenditure plan and annual updates; and, must include the performance goals from the three-year program and expenditure plan and annual updates in contracts with providers.

DHCS continues its ongoing effort to identify outcomes/measures for children and youth as part of the Performance Outcomes System Plan for Medi-Cal Specialty Mental Health Services for Children and Youth (POS). Since some of the evaluation efforts in the POS and the Evaluation Master Plan are similar, DHCS and the Accountability Commission will continue to collaborate to develop program performance measurements.

  • Response Type†: 6-Month
  • Estimated Completion Date: Fall 2014
  • Response Date: February 2014

California State Auditor's Assessment of Status: Partially Implemented


Agency Response*

The Performance Contract contains language specifying that counties must: report required data for the purpose of evaluating mental health outcomes; include reports on the achievement of performance outcomes in their three-year program and expenditure plan and annual updates; and, must include the performance goals from the three-year program and expenditure plan and annual updates in contracts with providers.

Specific statewide outcomes are established jointly by DHCS and the Accountability Commission, in collaboration with CMHDA and in consultation with the California Mental Health Planning Council (CMHPC). As additional outcomes are needed, DHCS will continue to work with the Accountability Commission and the CMHPC to develop consistent outcome definitions and uniform, statewide data reporting requirements by leading and/or consulting with various performance outcomes committees and workgroups in support of the Evaluation Master Plan.

The Performance Contract will be sent to the counties for signature approval in September 2013. The time required to fully execute this contract will depend on how quickly each county is able to gain Board of Supervisor approval. In the next report, this recommendation's implementation status will be updated with the number of counties that have fully executed their Performance Contract.

  • Response Type†: 60-Day
  • Estimated Completion Date: 2014
  • Response Date: October 2013

California State Auditor's Assessment of Status: Partially Implemented


All Recommendations in 2012-122

†Response Type refers to the interval in which the auditee is providing the State Auditor with their status in implementing recommendations made in an audit report. Auditees must submit a response regarding their progress in implementing recommendations from our reports at three intervals from the release of the report: 60 days, six months, and one year or subsequent to one year.

*Agency responses received after June 2013 are posted verbatim.


Report type

Report type
















© 2013, California State Auditor | Privacy Policy | Conditions of Use | Download Adobe PDF Reader