EVALUATION OF THE DEMONSTRATION. 88. The evaluation design must include a discussion of the goals and objectives set forth in Section II of these STCs, and develop evaluation questions specific to the changes implemented in the Demonstration during this extension period.
EVALUATION OF THE DEMONSTRATION. 103. Submission of Draft Evaluation Design. The state shall submit to CMS for approval a draft Evaluation Design for an overall evaluation of the demonstration within 120 days of CMS approval of the demonstration. At a minimum, the draft design must include a discussion of the goals, objectives, and specific hypotheses that are being tested, and identify outcomes measures that shall be used to evaluate the demonstration’s impact. It shall discuss the data sources, including the use of Medicaid encounter data, and sampling methodology for assessing these outcomes. The draft Evaluation Design must include a detailed analysis plan that describes how the effects of the demonstration shall be isolated from other initiatives occurring in the state. The draft design must describe the state’s process to contract with an independent evaluator.
EVALUATION OF THE DEMONSTRATION. 72. Submission of Draft Evaluation Design. The State should submit a draft evaluation plan to CMS no later than 120 days after the award of the demonstration. When developing the evaluation plan, the state should consider and include the following:
EVALUATION OF THE DEMONSTRATION. 84. Submission of a Draft Evaluation Design. The Commonwealth must submit to CMS for approval a draft evaluation design no later than 120 days after CMS’ approval of the demonstration. At a minimum, the draft evaluation design must include a discussion of the goals, objectives, and evaluation questions specific to the entire health care reform demonstration set forth in section II of these STCs. The draft design must discuss the outcome measures that will be used in evaluating the impact of the demonstration during the period of approval, particularly among the target population. It must discuss the data sources, including the use of Medicaid encounter data, and sampling methodology for assessing these outcomes. The draft evaluation design must include a detailed analysis plan that describes how the effects of the demonstration shall be isolated from other initiatives occurring in the Commonwealth. The draft design must identify whether the Commonwealth will conduct the evaluation, or select an outside contractor for the evaluation.
EVALUATION OF THE DEMONSTRATION. 92. Submission of a Draft Evaluation Design Update. The Commonwealth must submit to CMS for approval a draft evaluation design update no later than 120 calendar days after CMS’ approval date of the renewal. The draft evaluation design update must build and improve upon the evaluation design that was approved by CMS for demonstration period ending on June 30, 2014. At a minimum, the draft evaluation design must include a discussion of the goals, objectives, and evaluation questions specific to the entire health care reform demonstration set forth in section II of these STCs. The draft design must discuss the outcome measures that will be used in evaluating the impact of the demonstration during the period of approval, particularly among the target population, specific testable hypothesis, including those that focus on target populations for the demonstration and more generally on beneficiaries, providers, plans, market areas and public expenditures. The updated design should be described in sufficient detail to determine that it is scientifically rigorous. The data strategy must be thoroughly documented It must discuss the data sources, including the use of Medicaid encounter data, and sampling methodology for assessing these outcomes. The draft evaluation design must include a detailed analysis plan that describes how the effects of the demonstration shall be isolated from other initiatives occurring in the Commonwealth. The draft design must identify whether the Commonwealth will conduct the evaluation, or select an outside contractor for the evaluation. The design should describe how the evaluation and reporting will develop and be maintained to assure its scientific rigor and completion. In summary, the demonstration evaluation will meet all standards of leading academic institutions and academic journal peer review, as appropriate for each aspect of the evaluation, including standards for the evaluation design, conduct, and interpretation and reporting of findings. Among the characteristics of rigor that will be met are the use of best available data; controls for and reporting of the limitations of data and their effects on results; and the generalizability of results. Information from the external quality review organization (EQRO) may be considered for the purposes of evaluation, as appropriate. The updated design must describe the state’s process to contract with an independent evaluator, ensuring no conflict of interest.
EVALUATION OF THE DEMONSTRATION. 62. State Must Separately Evaluate Components of the Demonstration. As outlined in subparagraph (a), the outcomes from each evaluation component must be integrated into one programmatic summary that describes whether the State met the Demonstration goal, with recommendations for future efforts regarding all programs in the Demonstration. The State must submit to CMS for approval a draft evaluation design no later than October 1, 2011.
EVALUATION OF THE DEMONSTRATION
