Common use of Monitoring and evaluation arrangements Clause in Contracts

Monitoring and evaluation arrangements. 8.1 Evaluation of outreach activities and the impact of scholarship provision are essential to monitoring success. Enhanced evaluation of activities will be undertaken by increasing the breadth of evaluation. Currently, evaluation largely centres on activities undertaken within UCL. This will change to encompass all activities, both internal and external. Additional staffing resource will be recruited to take forward enhanced evaluation work. 8.2 360-degree evaluation will be utilised whereby Outreach staff, student ambassadors, targeted students/groups and teachers from schools and colleges are asked to provide both quantitative and qualitative evaluation of activities. Currently, focus groups are carried out with student ambassadors. These focus groups will be expanded to cover targeted students as well as teaching staff from schools and colleges. 8.3 Data gathered will be analysed and activities will be critically reviewed and, if this is found to be necessary, reshaped and improved. Outreach staff will work closely with colleagues in Student Funding to evaluate the impact on the student body of the UCL scholarship offering. The scholarship provision will be reviewed and, if necessary, retargeted to maximise impact. 8.4 These evaluation activities will be supported by the development of an integrated database that holds all evaluation data. This will allow for improved data interrogation and analysis across activities, enabling easier identification of successful activities and those where changes and improvements should be made. 8.5 UCL‟s performance and compliance with this Access Agreement, including the contribution to the National Scholarship Programme, its own bursary schemes, outreach activities, performance against targets and progress towards milestones, will be monitored by UCL‟s Academic Committee, on which there is student and external representation. The Academic Committee will report annually to UCL‟s Council on all matters relating to the Access Agreement. This framework is supported by regular monitoring by senior management within UCL‟s Registry and Academic Services and overseen by the Vice-Xxxxxxx (Operations) and Vice- Xxxxxxx (Academic and International).

Monitoring and evaluation arrangements. 8.1 Evaluation 7.1 The University will continue its policy of making admissions statistics publicly available, through the University of Cambridge Reporter and its web-site. Those statistics include data on the number of applications and acceptances by school type, region, gender, ethnicity and socio-economic classification. 7.2 The University’s adherence to this agreement and its progress in reaching the objectives indicated above will be monitored through the University’s Undergraduate Admissions Committee (jointly chaired by the Pro-Vice-Chancellor (Education) and the Secretary to the Colleges’ Senior Tutors Committee) which report to the principal University and Collegiate bodies. The Committee will take advice from the Admissions Forum, the intercollegiate body charged with managing undergraduate admissions and delivering agreed targets and objectives. The Undergraduate Admissions Committee will annually review application, offer and admission trends, particularly in respect of currently under- represented groups. It will also keep under review, and advise as necessary on the amendment of admissions and recruitment processes that have a bearing on securing a wide and diverse pool of well-qualified applicants. 7.3 Scrutiny of outreach activities and the impact of scholarship provision are essential to monitoring success. Enhanced evaluation of activities will be undertaken by increasing the breadth Outreach Steering Group (reporting to the Undergraduate Admissions Committee) which will co-ordinate and prioritise those activities and review their effectiveness. The success of evaluationoutreach activities (aside from those which are web-based or of a general aspiration-raising nature) will be monitored through analyses of qualitative evaluation and attendee and application data. 7.4 The University has identified specific groups that may be particularly affected by the new financial arrangements and so has prepared an Equality Assurance Assessment (EAA) in line with BIS guidance. Currently, evaluation largely centres The University will continue to consider any potential disproportionate or adverse impact on activities undertaken within UCLprotected groups (as defined by the Equality Act 2010) periodically via the groups described above. 7.5 We will develop systems to capture outreach activity covering UK schools and colleges. This process will change facilitate a co-ordinated approach to encompass all activities, both internal and external. Additional staffing resource will be recruited to take forward enhanced evaluation work. 8.2 360-degree evaluation will be utilised whereby Outreach staff, student ambassadors, targeted students/groups and teachers from interaction with those schools and colleges are asked and enable the effectiveness of outreach activities to provide be assessed through long-term data collection on each institution’s higher education applications, offers and admissions within both quantitative a Cambridge and qualitative evaluation of activities. Currently, focus groups are carried out with student ambassadors. These focus groups a national context. 7.6 Post-entry reviews will be expanded to cover targeted students as well as teaching staff from schools undertaken by continued analyses of retention rates and collegesexamination performances of relevant groups in comparison with those of the overall cohorts. 8.3 Data gathered 7.7 We will be analysed and activities will be critically reviewed and, if this is found continue to be necessary, reshaped and improved. Outreach staff will work closely monitor the ease with colleagues in Student Funding which students make the transition from school to evaluate the impact university on the student body of the UCL scholarship offeringa subject-by-subject basis. The scholarship provision will be reviewed and, if necessary, retargeted University has in recent years invested in a Transkills 25 Ibid 26 xxx.xxxxxxxxxxx.xxx/xxxxxxxx/xxx-xxxx-xxxxxx-xx-xxxxxx-trust-summer-schools/ Project to maximise impact. 8.4 These evaluation activities will be supported by the development of an integrated database that holds all evaluation data. This will allow for improved data interrogation and analysis across activities, enabling easier identification of successful activities and those where changes and improvements should be made. 8.5 UCL‟s performance and compliance assist with this Access Agreement, including the contribution transition27. The personal attention paid to the National Scholarship Programme, its own bursary schemes, outreach activities, performance against targets and progress towards milestones, needs of students through the Colleges will be monitored by UCL‟s Academic Committee, on which there is student and external representation. The Academic Committee will report annually continue to UCL‟s Council on all matters relating to the Access Agreement. This framework is supported by regular monitoring by senior management within UCL‟s Registry and Academic Services and overseen by the Vice-Xxxxxxx (Operations) and Vice- Xxxxxxx (Academic and International)enable prompt resolution of any individual difficulties.

Monitoring and evaluation arrangements. 8.1 Evaluation The University will continue its policy of making admissions statistics publicly available, through its web-site. Those statistics include data on the number of applications and acceptances by school type, region, gender, ethnicity and socio-economic classification. 8.2 The University’s adherence to this agreement and its progress in reaching the objectives indicated above will be monitored through the University’s Undergraduate Admissions Committee (jointly chaired by the Pro-Vice-Chancellor (Education) and the Secretary to the Colleges’ Senior Tutors Committee) which report to the principal University and Collegiate bodies. The Committee will take advice from the Admissions Forum, the intercollegiate body charged with managing undergraduate admissions and delivering agreed targets and objectives. The Undergraduate Admissions Committee will annually review application, offer and admission trends, particularly in respect of currently under- represented groups. It will also keep under review, and advise as necessary on the amendment of admissions and recruitment processes that have a bearing on securing a wide and diverse pool of well-qualified applicants. Each of these groups includes student representation. 8.3 The Cambridge bursary scheme and other financial support will be reviewed by the Undergraduate Admissions Committee through a specially tasked Cambridge Bursary Schemes Sub Group, which will monitor the operation and impact of schemes using annual reports and data analysis, and make recommendations as appropriate. 8.4 Scrutiny of outreach activities and the impact of scholarship provision are essential to monitoring success. Enhanced evaluation of activities will be undertaken by increasing the breadth Outreach Steering Group (reporting to the Undergraduate Admissions Committee) which will co-ordinate and prioritise those activities and review their effectiveness. The success of outreach activities (aside from those which are web-based or of a general aspiration-raising nature) will be monitored through annual analyses of qualitative evaluation and attendee and application data. It will not be possible to routinely measure the wider benefit to the HE sector of Cambridge activity until measures are put in place at a national level to assist with quantitative evaluation. Currently, evaluation largely centres on activities undertaken within UCL. This will change It is our intention to encompass all activities, both internal and external. Additional staffing resource will be recruited to take forward enhanced evaluation work. 8.2 360-degree evaluation will be utilised whereby Outreach staff, student ambassadors, targeted students/groups and teachers from schools and colleges are asked to provide both quantitative and qualitative evaluation of activities. Currently, focus groups are carried out with student ambassadors. These focus groups will be expanded to cover targeted students as well as teaching staff from schools and colleges. 8.3 Data gathered will be analysed and activities will be critically reviewed and, if this is found to be necessary, reshaped and improved. Outreach staff will work closely with colleagues in Student Funding to evaluate the impact on the student body of the UCL scholarship offering. The scholarship provision will be reviewed and, if necessary, retargeted to maximise impact. 8.4 These evaluation activities will be supported by the development of an integrated database that holds all evaluation data. This will allow for improved data interrogation and analysis across activities, enabling easier identification of successful activities and embed or grow those where changes and improvements should be madeinitiatives which make demonstrable progress towards their objectives. 8.5 UCL‟s performance The University has identified specific groups that may be particularly affected by the new financial arrangements and compliance so has prepared an Equality Assurance Assessment in line with BIS guidance. The University will continue to consider any potential disproportionate or adverse impact on protected groups (as defined by the Equality Act 2010) periodically via the groups described above. An Equality Assurance Assessment in relation to the University’s widening participation activities has been completed and approved by the University Equality Assurance Assessment Review Group to ensure that it fulfils its legal obligations in this area. It should be noted that national data regarding several protected characteristics does not exist, and so no comparisons can be made in any such assessment. 8.6 Post-entry reviews will be undertaken by continued analyses of retention rates and examination performances of relevant groups in comparison with those of the overall cohorts. 8.7 We will continue to monitor the ease with which students make the transition from school to university on a subject-by-subject basis. The University has in recent years invested in a Transkills Project to assist with this Access Agreement, including the contribution transition. The personal attention paid to the National Scholarship Programme, its own bursary schemes, outreach activities, performance against targets and progress towards milestones, needs of students through the Colleges will be monitored by UCL‟s Academic Committee, on which there is student and external representation. The Academic Committee will report annually continue to UCL‟s Council on all matters relating to the Access Agreement. This framework is supported by regular monitoring by senior management within UCL‟s Registry and Academic Services and overseen by the Vice-Xxxxxxx (Operations) and Vice- Xxxxxxx (Academic and International)enable prompt resolution of any individual difficulties.

Monitoring and evaluation arrangements. 8.1 Evaluation The University will continue its policy of making admissions statistics publicly available, through its web-site. Those statistics include data on the number of applications and acceptances by school type, region, gender, ethnicity and socio-economic classification. 8.2 The University’s adherence to this agreement and its progress in reaching the objectives indicated above will be monitored through the University’s Undergraduate Admissions Committee (jointly chaired by the Pro-Vice-Chancellor (Education) and the Secretary to the Colleges’ Senior Tutors Committee) which report to the principal University and Collegiate bodies. The Committee will take advice from the Admissions Forum, the intercollegiate body charged with managing undergraduate admissions and delivering agreed targets and objectives. The Undergraduate Admissions Committee will annually review application, offer and admission trends, particularly in respect of currently under- represented groups. It will also keep under review, and advise as necessary on the amendment of admissions and recruitment processes that have a bearing on securing a wide and diverse pool of well-qualified applicants. Each of these groups includes student representation. 8.3 The Cambridge bursary scheme, National Scholarship Programme and other financial support will be reviewed by the Undergraduate Admissions Committee through a specially tasked Cambridge Bursary Schemes Sub Group, which will monitor the operation and impact of schemes using annual reports and data analysis, and make recommendations as appropriate. 8.4 Scrutiny of outreach activities and the impact of scholarship provision are essential to monitoring success. Enhanced evaluation of activities will be undertaken by increasing the breadth Outreach Steering Group (reporting to the Undergraduate Admissions Committee) which will co-ordinate and prioritise those activities and review their effectiveness. The success of outreach activities (aside from those which are web-based or of a general aspiration-raising nature) will be monitored through annual analyses of qualitative evaluation and attendee and application data. It will not be possible to routinely measure the wider benefit to the HE sector of Cambridge activity until measures are put in place at a national level to assist with quantitative evaluation. Currently, evaluation largely centres on activities undertaken within UCL. This will change It is our intention to encompass all activities, both internal and external. Additional staffing resource will be recruited to take forward enhanced evaluation work. 8.2 360-degree evaluation will be utilised whereby Outreach staff, student ambassadors, targeted students/groups and teachers from schools and colleges are asked to provide both quantitative and qualitative evaluation of activities. Currently, focus groups are carried out with student ambassadors. These focus groups will be expanded to cover targeted students as well as teaching staff from schools and colleges. 8.3 Data gathered will be analysed and activities will be critically reviewed and, if this is found to be necessary, reshaped and improved. Outreach staff will work closely with colleagues in Student Funding to evaluate the impact on the student body of the UCL scholarship offering. The scholarship provision will be reviewed and, if necessary, retargeted to maximise impact. 8.4 These evaluation activities will be supported by the development of an integrated database that holds all evaluation data. This will allow for improved data interrogation and analysis across activities, enabling easier identification of successful activities and embed or grow those where changes and improvements should be madeinitiatives which make demonstrable progress towards their objectives. 8.5 UCL‟s performance The University has identified specific groups that may be particularly affected by the new financial arrangements and compliance so has prepared an Equality Assurance Assessment in line with BIS guidance. The University will continue to consider any potential disproportionate or adverse impact on protected groups (as defined by the Equality Act 2010) periodically via the groups described above, and is currently drafting a further Equality Assurance Assessment in relation to its widening participation activities to ensure that it fulfils its legal obligations in this area. It should be noted that national data regarding several protected characteristics does not exist, and so no comparisons can be made in any such assessment. 8.6 Post-entry reviews will be undertaken by continued analyses of retention rates and examination performances of relevant groups in comparison with those of the overall cohorts. 8.7 We will continue to monitor the ease with which students make the transition from school to university on a subject-by-subject basis. The University has in recent years invested in a Transkills Project to assist with this Access Agreement, including the contribution transition32. The personal attention paid to the National Scholarship Programme, its own bursary schemes, outreach activities, performance against targets and progress towards milestones, needs of students through the Colleges will be monitored by UCL‟s Academic Committee, on which there is student and external representation. The Academic Committee will report annually continue to UCL‟s Council on all matters relating to the Access Agreement. This framework is supported by regular monitoring by senior management within UCL‟s Registry and Academic Services and overseen by the Vice-Xxxxxxx (Operations) and Vice- Xxxxxxx (Academic and International)enable prompt resolution of any individual difficulties.

Monitoring and evaluation arrangements. 8.1 Evaluation of outreach activities and 12.1 Annually, the impact of scholarship provision are essential University reports to monitoring success. Enhanced evaluation of activities will be undertaken by increasing the breadth of evaluation. CurrentlyOffice for Fair Access, evaluation largely centres on activities undertaken within UCLOFFA, in its Annual Monitoring Report. This will change to encompass includes all activities, both internal expenditure from additional fee income on financial support for lower income students and external. Additional staffing resource will be recruited to take forward enhanced evaluation work. 8.2 360other under-degree evaluation will be utilised whereby Outreach staff, student ambassadors, targeted students/represented groups and teachers from schools reports progress against objectives and colleges are asked milestones. We look forward to provide both quantitative and qualitative evaluation of activities. Currently, focus groups are carried out with student ambassadors. These focus groups will be expanded to cover targeted students as well as teaching staff from schools and colleges. 8.3 Data gathered will be analysed and activities will be critically reviewed and, if this is found to be necessary, reshaped and improved. Outreach staff will work closely with colleagues in Student Funding to evaluate the impact on the student body of the UCL scholarship offering. The scholarship provision will be reviewed and, if necessary, retargeted to maximise impact. 8.4 These evaluation activities will be supported by the development of an integrated database that holds all the national evaluation data. This will allow for improved data interrogation framework to inform our evaluation of access and analysis across activities, enabling easier identification of successful student success activities and those where changes and improvements should be madeeffectively. 8.5 UCL‟s performance and compliance with this Access Agreement12.2 Internally, including the contribution to the National Scholarship Programme, its own bursary schemes, our basic monitoring of outreach activities, performance initiatives includes progress against targets and milestones and is reported annually. The elementary evidence base is provided through Management Information Services reporting which identifies volumes and outputs of outreach activity. Proportions of target groups benefiting from WP activities are analysed through this data capture. The regular statistical analysis offers the opportunity to assess the nature and delivery of activity and informs evaluation and future planning. 12.3 Most recent measurement of outcomes has shown that objectives have been delivered, exceeding expectation of engagement/applications/enrolments to the University from participants, and it is pleasing to note that the work has shown consistent improvement in participant application to Preparation for Higher Education/Higher Education programmes, which have resulted in enrolments. 12.4 The University prepares an annual report during the Autumn of each year, which considers data on retention, progression and achievement of all minority target groups. Separate reports consider responses to both the National Student Survey and the internal Student Perception Survey, again analysed by minority target group where available. This enables a clear overview of where action might be appropriate to support the retention, achievement and progression of under-represented groups. 12.5 The University further intends to build upon the current self-assessment process by developing an integrated Targeting, Monitoring and Evaluation Strategy that focuses both on the OFFA National Strategy for Access and Student Success and the OFFA Strategic Plan. The strategy, based on HEFCE guidance, will have four levels: Level 1: Basic monitoring – progress towards against targets and milestones, will be monitored by UCL‟s Academic Committeeoutputs and volumes Level 2: Targeting – proportions of the target groups benefitting from WP activities Level 3: Measurement of outcomes – impacts and unintended consequences, on which there short-, medium- and long-term Level 4: Value for money – cost-effectiveness. 12.6 It was intended to introduce this process for 2016/17, but staff absence has resulted in its deferral to future years. In addition, the University is student considering membership of the monitoring and external representationevaluation service for subscribing Higher Education Institutions, the Higher Education Access Tracker (HEAT) Service. The Academic Committee will report annually service is clearly of value, but as the costs are not proportional to UCL‟s Council on all matters relating to institutional size, subscription requires careful consideration of the Access Agreement. This framework is supported by regular monitoring by senior management within UCL‟s Registry and Academic Services and overseen by the Vice-Xxxxxxx (Operations) and Vice- Xxxxxxx (Academic and International)benefits.

Monitoring and evaluation arrangements. 8.1 Evaluation 7.1 The University will continue its policy of making admissions statistics publicly available, through the University of Cambridge Reporter and its web-site. Those statistics include data on the number of applications and acceptances by school type, region, gender, ethnicity and socio-economic classification. 7.2 The University’s adherence to this agreement and its progress in reaching the objectives indicated above will be monitored through the University’s Undergraduate Admissions Committee (jointly chaired by the Pro-Vice-Chancellor (Education) and the Secretary to the Colleges’ Senior Tutors Committee) which report to the principal University and Collegiate bodies. The Committee will take advice from the Admissions Forum, the intercollegiate body charged with managing undergraduate admissions and delivering agreed targets and objectives. The Undergraduate Admissions Committee will annually review application, offer and admission trends, particularly in respect of currently under- represented groups. It will also keep under review, and advise as necessary on the amendment of admissions and recruitment processes that have a bearing on securing a wide and diverse pool of well-qualified applicants. 7.3 Scrutiny of outreach activities and the impact of scholarship provision are essential to monitoring success. Enhanced evaluation of activities will be undertaken by increasing the breadth Outreach Steering Group (reporting to the Undergraduate Admissions Committee) which will co-ordinate and prioritise those activities and review their effectiveness. The success of evaluation. Currently, outreach activities (aside from those which are web-based or of a general aspiration-raising nature) will be monitored through analyses of qualitative evaluation largely centres on activities undertaken within UCLand attendee and application data. 7.4 The University has identified specific groups that may be particularly affected by the new financial arrangements and so has prepared an Equality Assurance Assessment in line with BIS guidance. 7.5 We will develop systems to capture outreach activity covering UK schools and colleges. This process will change facilitate a co-ordinated approach to encompass all activities, both internal and external. Additional staffing resource will be recruited to take forward enhanced evaluation work. 8.2 360-degree evaluation will be utilised whereby Outreach staff, student ambassadors, targeted students/groups and teachers from interaction with those schools and colleges are asked and enable the effectiveness of outreach activities to provide be assessed through long-term data collection on each institution’s higher education applications, offers and admissions within both quantitative a Cambridge and qualitative evaluation of activities. Currently, focus groups are carried out with student ambassadors. These focus groups a national context. 7.6 Post-entry reviews will be expanded to cover targeted students as well as teaching staff from schools undertaken by continued analyses of retention rates and collegesexamination performances of relevant groups in comparison with those of the overall cohorts. 8.3 Data gathered 7.7 We will be analysed and activities will be critically reviewed and, if this is found continue to be necessary, reshaped and improved. Outreach staff will work closely monitor the ease with colleagues in Student Funding which students make the transition from school to evaluate the impact university on the student body of the UCL scholarship offeringa subject-by-subject basis. The scholarship provision will be reviewed and, if necessary, retargeted University has in recent years invested in a Transkills Project to maximise impact. 8.4 These evaluation activities will be supported by the development of an integrated database that holds all evaluation data. This will allow for improved data interrogation and analysis across activities, enabling easier identification of successful activities and those where changes and improvements should be made. 8.5 UCL‟s performance and compliance assist with this Access Agreement, including the contribution transition22. The personal attention paid to the National Scholarship Programme, its own bursary schemes, outreach activities, performance against targets and progress towards milestones, needs of students through the Colleges will be monitored by UCL‟s Academic Committee, on which there is student and external representation. The Academic Committee will report annually continue to UCL‟s Council on all matters relating to the Access Agreement. This framework is supported by regular monitoring by senior management within UCL‟s Registry and Academic Services and overseen by the Vice-Xxxxxxx (Operations) and Vice- Xxxxxxx (Academic and International)enable prompt resolution of any individual difficulties.