Related Links

• Department of Consumer Affairs
• Department of Public Health
• Department of Health Care Services

 

 

      

NOT USED BY DOR

Attachment 3

Evaluation Plan
(34 CFR 364.21(g) and 364.38)

Monitoring and evaluating the implementation of the State Plan for Independent Living is an important SILC responsibility, and oversight will continue to be delegated to the Monitoring and Evaluation Committee. The DOR and the Monitoring and Evaluation Committee, a standing committee of the SILC, developed a monitoring plan for state-funded IL programs during the previous SPIL. The DOR will continue to use this monitoring plan, which includes progressive discipline, corrective actions and technical assistance to ILCs, which do not pass an audit of their activities.

The SILC and DOR are key components of the IL service delivery system under Chapter 1, and continually seek input about agency effectiveness or opportunities for positive change. The SILC will continue to distribute a periodic satisfaction survey to all ILCs and partner agencies to be in a position to provide better service in the future.

Additionally, the SILC also reviews summaries of Consumer Satisfaction Surveys from ILCs, which are required to be submitted on an annual basis. Staff review the results immediately upon receipt, and share any problematic findings with the DOR. The SILC’s Monitoring and Evaluation Committee is provided a summary of these reports and the findings from the annual 704 report, to help judge the effectiveness of the program. The SILC also encourages feedback via its interactive website that allows consumers to email their input directly to the SILC.

Consumers from across the state call the SILC to express varying levels of satisfaction with ILC services, and SILC staff routinely solicit feedback from consumers at trade shows, job fairs, during community visits, and at conferences.
Recommendations for improvement are given careful consideration, and the DOR or appropriate ILCs are notified if corrections are needed.

The SILC also reviews the individual 704 reports submitted by each ILC, seeking indications that service needs are being met in each catchment area. The DOR and RSA share findings of ILC compliance reviews with the SILC, which enables SILC staff to offer technical assistance where needed via telephone or on-site visits. SILC members are also invited to join RSA / DOR compliance review teams, which allows members to gain valuable insight about ILC operations and provide technical assistance when appropriate. When problems are identified in a particular ILC, the DOR staff will continue to confer with SILC staff on potential solutions, and work together to assure that all potential avenues of technical assistance or corrective action are considered.

The DOR and SILC will continue to ensure that funds are expended in accordance with funding priorities outlined in the SPIL to meet the unmet needs documented in the statewide needs assessment that was completed in 1996 and supplemented through ongoing public hearings. To assist in determining that expenditures are effective, the DOR and SILC will review reports generated by grantees receiving funds for specific purposes and funded under Title VIIB of the Act.

Evaluation and monitoring activities will also be conducted by the DOR to assess the quality of ILC programs and services and implementation of SPIL objectives. Staff of the DOR receives three types of evaluative reports from grantees. They are:

A. A quarterly “California Independent Living Report,” required of all grantees, that provides specific information related to demographics, consumer service programs, and community service programs. The report further provides an overview of the ILC’s progress related to goals and objectives and the number of consumers served as well as an up to date progress of activities.

B. As of December 1994, ILCs receiving funds through the DOR were required to meet the requirements of Title VII, whether or not they received Title VIIB or Title VIIC funds. As of March 1995, all ILCs, regardless of funding, were required to complete state reports that incorporate all demographic and service data required on the federal 704 reports. This required that ILCs change their reporting year from the state fiscal year to the federal fiscal year. This will continue in the 2005-2007 SPIL.

C. An evaluation at the conclusion of any Title VIIB grant year. These evaluations will summarize activities of the program, whether or not goal and objectives were met and how independence was increased because of the program or services.

Effective February 15, 1998 , the DOR evaluates all ILCs through site reviews done in accordance with Section 725 of the Act. The process includes a comprehensive on-site review, which includes interviewing consumers; an exit interview to discuss findings with the board, management and appropriate staff; reports/letters of findings and recommendations; and follow-up by DOR Resource Specialists to assure compliance. The on-site review panel includes a peer reviewer. During the 2005-2007 SPIL, the DOR will incorporate into the compliance review an assessment of consumers served by zip code in order to identify underserved areas. ILC evaluations are provided to the SILC to help ensure that planned outcomes of SILC goals are met. This will continue in the 2005-2007 SPIL.