Evaluation Design. USD 489 will utilize the e4E Evaluation Tool designed by Southwest Plains Regional Service Center (SWPRSC) for teacher evaluation. *See forms in Appendix.
Evaluation Design. The Evaluation Design shall include the following core components to be approved by CMS:
Evaluation Design. The evaluation design will utilize a post-only assessment with a comparison group. The timeframe for the post-only period will begin when the current demonstration period begins, and ends when the current demonstration period ends.
Evaluation Design. The evaluation design will be based on a mixed methods approach. Both qualitative and quantitative methods will be used to address evaluation questions. The CDC’s updated guidelines for evaluating surveillance systems will be used to determine the efficacy of the surveillance system. The following five evaluation questions will be addressed:
Evaluation Design. Describe the proposed design, methods and analysis plan for assessing the effectiveness of the intervention. The specific type of evaluation method chosen should reflect the nature of the intervention, feasibility, and ethical considerations. Potential threats to the validity of the study should be described along with how such threats will be recognized and addressed. The status of all necessary measurement instruments should be described. If any materials are not extant, the methods and time frame for measure development, pilot testing, and validation should be given. For data collected from archival records (e.g., hospital records, police records, etc.) the proposal should discuss issues of accessibility, reliability, and validity of those data.
Evaluation Design. Exploratory cross sectional study design was used in this study. The design was selected because the study wanted to explore the phenomena under study and it was cross sectional because data about the phenomena were obtained at one moment in time.
Evaluation Design. Proposed methodology, strategies, or approach clearly support attainment of project purpose and objectives. Key activities and procedures to complete the project are clearly articulated and reasonable.
Evaluation Design. Provide information on how the evaluation will be designed. For example, will the evaluation utilize a pre/post comparison? A post-only assessment? Will a comparison group be included?
Evaluation Design. The State must submit to CMS for approval a draft evaluation design no later than January 1, 2007. At a minimum, the draft design must include a discussion of the goals, objectives, and evaluation questions specific to the purposes of and expenditures made by the State for its health care reform activities. The draft design must discuss the outcome measures that will be used in evaluating the impact of these activities on the efficient operation of the State’s health care system during the period of the Demonstration. The outcome measures below represent agreed-upon metrics under which the State and CMS can measure the shared financial benefit of the health care reforms and must be included in the evaluation design: • Nursing home admissions - “Value of Averted Medicaid Nursing Home Admissions”: For each fiscal year under the demonstration, the number of the reduction in the number of Demonstration Year (DY) Medicaid bed-days below Base Year (BY) level * average cost per bed-day * DY Medicaid enrollees.
Evaluation Design. The draft design must discuss the outcome measures that shall be used in evaluating the impact of the Demonstration during the period of approval. It shall discuss the data sources, including the use of Medicaid encounter data, and sampling methodology for assessing these outcomes. The draft evaluation design must include a detailed analysis plan that describes how the effects of the Demonstration shall be isolated from other initiatives occurring in the State. The evaluation designs proposed for each question may include analysis at the beneficiary, provider, and aggregate program level, as appropriate, and include population stratifications to the extent feasible, for further depth and to glean potential non-equivalent effects on different sub-groups. The draft design shall identify whether the State will conduct the evaluation, or select an outside contractor for the evaluation.
