Program Research, Planning, and Evaluations. In collecting data for its evaluations and research projects, PCG provides a comprehensive set of services. This includes sample design, instrument construction, the data collection itself and both qualitative and quantitative analyses. Most of our sample designs involve stratified, clustered samples representative of the universe to be studied, with the analysis weighted appropriately. Qualitative: Focus group instruments are relatively short, allowing participants to have expansive discussions of the issues. Interview instruments are semi-structured, meaning that there are fixed questions, but the answers are expected to be open-ended and the respondents are encouraged to elaborate their answers as much as they desire. We use standard content analysis to analyze interview information, often facilitated by the use of NVivo software. Quantitative: Aside from focus groups, interviews and surveys, PCG also employs case readings and analysis of administrative data sets. The latter permits the entire client population to be examined without sampling, while the former allows collection of information which is not available in coded fields of administrative data systems. The analysis merges the two sources of data for those cases selected into the case reading sample, so that the more detailed information can be correlated to the data from the administrative data. The quantitative analyses focus first on client outcomes (and costs, where requested) and then on identifying those sub-populations which are most and least likely to achieve positive outcomes. In addition, we work to connect the quantifiable process measures related to a service, such as intensity and duration, to the probability of success. Both: Survey instruments combine both quantitative and qualitative information. Most of the questions are fixed answer, asking either for categorical answers, e.g., yes/no or gender, or for ratings using Likert scales. All survey instruments end with open-ended questions, asking respondents to share what they liked most and least about a program or service or simply whether they have anything they would like to add. Most surveys are designed to be completed online, but telephone and paper surveys are also used when warranted. When multiple methods are used, qualitative and quantitative analyses will be integrated so that each method informs the other. Final evaluation reports integrate the qualitative and quantitative data so that each informs the other. The...
Program Research, Planning, and Evaluations. MAXIMUS has supported several states with researching available programs, subsequently planning and implementing the selected program, and providing evaluation services once operational. Examples of our experience are described in Exhibit 2.1.3-1: Program Research, Planning and Evaluation Practices. Gather and Review Existing Documentation We review documentation to inform us on the current service delivery model, including organizational charts, budgets, operational functions and job descriptions, and policies and procedures. Conduct Ad Hoc Research MAXIMUS staff conduct reviews and analysis, including surveys of practices in other states, to identify best practices and to inform our recommendations for implementation. Federal and state guidelines, regulations, and policies are reviewed for program compliance.
Program Research, Planning, and Evaluations. 🢝 🢝 During the Learn Phase, we take the time to fully understand the customer's research objectives to ensure we select appropriate research/evaluation methods. Ex: For our CMHI evaluation projects, we discussed each participating grantee's program to understand what evaluation techniques would be appropriate for the programs and policies they implemented in their individual community.
Program Research, Planning, and Evaluations. HMA’s approach to conducting program research, planning, and evaluation begins with the identification of a team of SMEs with content specific and program design, implementation, and evaluation expertise. The HMA project coordinator and team will collaborate with the client’s executive sponsor to understand the program goals, identify measurable objectives, and develop and implement the specified tasks to facilitate process and outcome evaluations. Successful, effective programs are founded on a clear understanding of program participants’ need and an understanding of best practices in addressing those needs. To assess the need for any program, HMA SMEs use a mixed-methods approach that can include literature reviews of professional peer reviewed publications, governmental material, and grey literature; reviews of existing community needs assessments conducted by local agencies or businesses; and interviews with key stakeholders including program implementers and participants and agency executives. To develop a robust understanding of community need, HMA uses a proprietary data tool to conduct analyses of publicly available data from sources such as the U.S. Census Bureau and extrapolate data to drill down on small units of geography. We can also conduct analyses of other non-public data sources supplied by the client using statistical software tools such as SEQUEL, SAS, or SPSS. Additionally, our SMEs in geospatial mapping bring great value to program planning efforts by using geospatial software such as Arc.GIS or Tableau to identify geographic variations in demographic, health, non-clinical needs, and other indicators that can inform decision-making around identifying key target populations or areas for any specific program implementation. To be resourceful in planning programs, we are careful to research best practices to identify existing programs that have been proven effective that the state can adopt or adapt. This activity can not only reduce program design costs but can also inform implementation and evaluation. HMA approaches program planning holistically, with a clear understanding of the importance of designing programs with goals and measurable objectives that facilitate process and outcome evaluations throughout program implementation. We do this to ensure that course corrections to any program can be made at any phase and at any time. We help our clients develop logic models and objectives with “SMART” criteria (Specific, Measurable, Achiev...
Program Research, Planning, and Evaluations. FE Proposed Team Members Project Initiation Meeting Agenda FE Representative Projects: Program Research, Planning & Evaluation
Program Research, Planning, and Evaluations. Meridian offers program research, planning, and evaluation services to help clients understand the impact of potential programs, plan appropriately, or evaluate program feasibility. Meridian is comprised of industry experts that understand the importance of properly identifying key stakeholders and establishing programs that are planned, managed, and evaluated in a way that demonstrates both the fiscal and civic values of those programs. Xxxxxxxx has a twenty-year track record within the public sector and private sector guiding the set up and evaluation of large programs. That experience includes the development of flexible methodologies, templates, and tools to measure KPI’s and objectively plan and evaluate large scale and small programs. The State of Florida Department of Management Services Meridian has guided both billion-dollar enterprise level software implementation programs and singularly focused programs at small government entities. In addition to providing program guidance, Meridian can also help organizations establish proper data governance and implement technology that enables meaningful insights. Proper data governance and data stewardship maintains the integrity of the data which is critically important to public sector entities that have an obligation to provide data that is relevant and transparent. The technology enablers create the means to analyze data to evaluate program effectiveness and support program decisions.
Program Research, Planning, and Evaluations. The CDR Team believes program efficacy begins through analysis of current performance, planning to establish goals, and establishing a system of constant evaluation through measured metrics. CDR team members used that approach in the past to address problems facing the State of Florida, with demonstrated success. For example, the Florida Department of Health under the direction of several CDR team members, transformed a billion dollar plus annual health service delivery system for medically complex children from a fee-for-service, non-value based system of care with open ended expenditures that were concerning to the state budget authorities, to a risk/value-based payment system introducing predictable appropriations for the Legislature while substantially improving the service delivery and benefit options for families and medically complex children below the age of 21. In addition to meeting fiscal and service delivery transformation objectives established by the agency and its stakeholders, the new service delivery system also mitigated risks related to ongoing litigation, fraud and abuse by network providers, failures to meet Healthcare Effectiveness and Data Information Set (HEDIS) and quality outcome benchmarks and numerous other challenges. This was the largest competitive procurement (5-year/$7B) in the Florida Department of Health’s recent history and was implemented successfully following two years of planning, buy-in with public and private stakeholders and policymakers, and success in the administrative court following the CDR team member’s appointment as the agency expert/representative. Similarly, CDR team members were involved in the restructuring of Florida’s trauma system. The effort to do so took more than a year to accomplish due to rulemaking and litigation, and involved internal and contracted external program evaluation when necessary. The resulting rulemaking rubric created a continuous, annual planning and evaluation of Florida’s trauma system to determine need and placement of future trauma centers. The trauma rules were ultimately deemed valid through administrative litigation in which a CDR team member served as agency representative. CDR has built a team that understands program research, planning, and constant evaluation are essential for operational success. The CDR Team includes members with significant experience preparing complex studies, analyses, scenarios, and reports in the State of Florida areas of financial services (C...
Program Research, Planning, and Evaluations. Xxxxxxx may employ a variety of approaches to support program evaluation and overall performance measurement. Specific strategies will be tailored to the needs of the customer, with techniques employed to support performance reporting and development of customized tools for ongoing performance measurement. Tactics which may be used by Xxxxxxx include problem solving methodologies, such as DRIVE (Define, Review, Identify, Verify, and Execute); process mapping/flowcharts; root cause analysis; statistical analysis/data analysis; and data visualization. This is in addition to other qualitative program research tasks that may be executed by the Xxxxxxx Team continent upon the needs of the customer. The following presents the primary tasks that will be executed by Xxxxxxx in support of performance measurement projects.
Program Research, Planning, and Evaluations. Our first step on receipt of a task order will be to convene an inception meeting with the Customer Project Manager and team. The meeting will lay the groundwork for the remaining tasks and project plan, and to clearly define program objectives. Depending on the scope at hand, the project plan is likely to involve data collection from internal sources, a series of interviews or targeted meeting sessions, and/or external stakeholders. Balmoral will establish a proposed list of targets for data collection. An important point to be established at inception is the definition of successful programmatic outcomes and metrics that have been used or proposed to measure success. Meeting minutes will be prepared and delivered within three business days.
Program Research, Planning, and Evaluations. THF has been performing consulting engagements for over 26 years. During this time, we have built relationships with our clients and proven our ability to provide an outstanding service and a high-quality work product. Our team frequently conducts program research, planning, and evaluations for our clients. We have significant experience researching Federal regulations, State regulations, contract requirements, and evaluating programs. In addition, our team possesses the education and experience necessary to assist the State with program research, planning, and evaluations. Our team is also intimately familiar with federal grant requirements under Uniform Guidance and the Single Audit requirements. Our team’s approach to our engagements includes significant communications with the project team, frequent status reports including work progress, risks, issues log, and contact logs. We manage the project to our client’s expectations and implement and execute programs for our clients. The program requirements and our client’s scope of work drives our approach. We view each project as an opportunity to collaborate and develop an end product that is financially feasible and an effective tool for use by our client. Our approach will consist of four phases: planning, data gathering and fieldwork, data analysis, and reporting. Planning the engagement is extremely important to have a successful project. The project scope of work is defined, stakeholders are identified, a kick-off meeting will occur, the project team is identified, the communication plan is established, a risk/issues log is developed, and a timeline based on milestones is created along with a project budget. Our team will gain a full understanding of the program the State would like researched, planned, and evaluated. The understanding will allow our team to develop a work program and work plan to accomplish the goals of the engagement. Federal laws, rules, and regulations will be reviewed that govern the program. Data gathering and fieldwork phase will allow the team to review the contracts and documentation and make observations and inquiries of management as to the overall goals and objectives of the program. Data gathering also includes surveys and statistical sampling to develop and extrapolate findings to the overall population of data. the reporting phase. The reporting phase generally consists of an executive summary, methodology, scope, and approach, conclusion, observations, findings, and re...
