Common use of Promotional Examination Procedure Clause in Contracts

Promotional Examination Procedure. (A) The Commission intends to continue to administer four (4) part promotional examinations for the ranks of Police Sergeant and Police Lieutenant. These examinations shall consist of the following: (1) an open-book multiple-choice examination; (2) a closed-book multiple-choice examination; (3) a work sample component; and (4) an oral board component. The Commission intends to administer a two-part promotional examination for the rank of Police Commander. This examination shall consist of the following: (1) a work sample component; and (2) an oral board component. The Lodge's testing experts shall be provided a draft and a final copy of each part of all promotional examinations, together with the weightings for each part based on current (B) The development of certain test administration policies and procedures shall be discussed by a joint committee comprised of members appointed by the Commission and the Lodge. (C) The procedures set forth in Section 15.3(A) shall apply to all promotional examinations given, unless the Commission provides the Lodge notice of intent to change parts of the examination process as specified in Section 15.3(A). Should the Lodge's testing experts be dissatisfied with the Commission's weighting for each examination part, the Lodge's testing experts shall notify the Commission. In either event, the Lodge's testing experts shall be consulted, permitted to participate in discussions with the Commission as to any intended change, and if the Lodge believes that an intended change or the Commission's weighting for each examination part is in conflict with any criteria enumerated in Section 15.1 and/or violates generally accepted professional standards, such proposed change(s) are subject to Sections 15.3(D) and 15.4. (1) The Commission will provide the Lodge's testing consultant(s) with final draft copies of the job analysis and the proposed test plan for the test development process together with documentation used by the Commission in completing these phases. The "test plan" shall include plans for: pretest candidate training, collection of content validity data, collection of other validity data (if used), documentation of validity including mapping back procedures, training for all subject matter experts (SME's), criteria for selection and training of panel members, determination of the test components and their content, the system to be used to combine scores from the phases to obtain the total examination score, and a tentative schedule of dates including the target dates the Lodge's testing consultant(s) should be provided with the draft and final copies of the job analysis, test plan, documentation, the target dates for test administration and test results release procedure. The Lodge's testing consultant(s) shall submit their comments, if any, to the Commission on the final draft copies of the job analysis and test plan within ten (10) working days of their receipt of these materials. Thereafter, the Commission shall provide to the Lodge's testing consultant(s) final copies of the job analysis and test plan. Any grievance relating to the job analysis or test plan as provided in Section 15.4 must be filed within five (5) working days of the date these final copies were received by the Lodge's testing consultant(s). (2) The Commission will provide the Lodge's testing consultant(s) with final draft copies of each test phase and training objectives and materials, together with documentation used by the Commission in developing the test and pretest candidate training objectives and materials. Such documentation and test materials include test instructions, reading lists, test content, scoring keys, rating scales, scoring procedures, and test administration policies and procedures. These final draft test materials and access to related documentation shall be provided to the Lodge's testing consultant(s) at least ten (10) working days before test materials are put into final form. The Commission shall provide to the Lodge's testing consultant(s) final copies of test materials for review at least ten (10) working days before test materials are prepared for distribution to candidates. Any grievance relating to test construction or training of candidates, as provided in Section 15.4, must be filed within five (5) working days of the date final copies of the test materials and training materials and program are received by the Lodge's testing consultant(s). It is understood that final copies of the training material and program may be provided prior to submission of the final copies of the test materials, so that training of candidates can commence while final test construction is being completed, in which case any grievance regarding the training materials and program must be filed within five (5) working days of the date those documents are received by the Lodge's testing consultant(s). (3) Only those items related to the grievance shall be stayed pending the outcome of the grievance/arbitration. (4) The filing or processing of a grievance/arbitration shall not preclude the Commission from proceeding with test construction or test administration work that is not affected by and/or related to the grievance/arbitration. (5) Notwithstanding the listing of specific times in paragraphs (D)(1) and (D)(2) of this Section within which grievances may be filed, the Lodge is not precluded from filing a grievance as to the violation of any other specific Section of this Article, provided that such grievance is filed within ten (10) working days after such alleged violation becomes known to the Lodge, pursuant to the procedure provided in Section 15.4. However, no grievance shall be filed after certification of the eligible list. The eligible list shall not be certified until at least ten (10) working days after the first date of publication of the tentative eligible list or two (2) working days after any protest decisions have been received by a protesting member, whichever date is later. (6) The Commission shall provide, for continued test assessment and improvement, access to data files from which the Lodge's testing consultant(s) can perform statistical analyses of test results. The Lodge's testing consultant(s) shall provide the Commission with copies of any formal analyses or reports on test results. The Commission shall also provide to the Lodge's testing consultant(s), for continued test assessment and improvement, item analyses and other statistical analyses that the Commission performs except when such analyses are performed at the request of the City Attorney's Office.

Promotional Examination Procedure. (A) The Commission intends to continue to administer four (4) part promotional examinations for the ranks of Police Sergeant and Police Lieutenant. These examinations shall consist of the following: (1) an open-book multiple-choice examination; (2) a closed-book multiple-multiple- choice examination; (3) a work sample component; and (4) an oral board component. The Commission intends to administer a two-part promotional examination for the rank of Police Commander. This examination shall consist of the following: (1) a work sample component; and (2) an oral board component. The Lodge's ’s testing experts shall be provided a draft and a final copy of each part of all promotional examinations, together with the weightings for each part based on currentcurrent job analyses, prior to administration thereof, for review and comment, as provided in this Section 15.3. (B) The development of certain test administration policies and procedures shall be discussed by a joint committee comprised of members appointed by the Commission and the Lodge. (C) The procedures set forth in Section 15.3(A) shall apply to all promotional examinations given, unless the Commission provides the Lodge notice of intent to change parts of the examination process as specified in Section 15.3(A). Should the Lodge's ’s testing experts be dissatisfied with the Commission's ’s weighting for each examination part, the Lodge's ’s testing experts shall notify the Commission. In either event, the Lodge's ’s testing experts shall be consulted, permitted to participate in discussions with the Commission as to any intended change, and if the Lodge believes that an intended change or the Commission's weighting for each examination part is in conflict with any criteria enumerated in Section Police Contract Negotiations Toolkit: Columbus 71 15.1 and/or violates generally accepted professional standards, such proposed change(s) are subject to Sections 15.3(D) and 15.4. (1) The Commission will provide the Lodge's ’s testing consultant(s) with final draft copies of the job analysis and the proposed test plan for the test development process together with documentation used by the Commission in completing these phases. The "“test plan" ” shall include plans for: pretest candidate training, collection of content validity data, collection of other validity data (if used), documentation of validity including mapping back procedures, training for all subject matter experts (SME's’s), criteria for selection and training of panel members, determination of the test components and their content, the system to be used to combine scores from the phases to obtain the total examination score, and a tentative schedule of dates including the target dates the Lodge's Xxxxx’s testing consultant(s) should be provided with the draft and final copies of the job analysis, test plan, documentation, the target dates for test administration and test results release procedure. The Lodge's ’s testing consultant(s) shall submit their comments, if any, to the Commission on the final draft copies of the job analysis and test plan within ten (10) working days of their receipt of these materials. Thereafter, the Commission shall provide to the Lodge's ’s testing consultant(s) final copies of the job analysis and test plan. Any grievance relating to the job analysis or test plan as provided in Section 15.4 must be filed within five (5) working days of the date these final copies were received by the Lodge's ’s testing consultant(s). (2) The Commission will provide the Lodge's ’s testing consultant(s) with final draft copies of each test phase and training objectives and materials, together with documentation used by the Commission in developing the test and pretest candidate training objectives and materials. Such documentation and test materials include test instructions, reading lists, test content, scoring keys, rating scales, scoring procedures, and test administration policies and procedures. These final draft test materials and access to related documentation shall be provided to the Lodge's ’s testing consultant(s) at least ten (10) working days before test materials are put into final form. The Commission shall provide to the Lodge's ’s testing consultant(s) final copies of test materials for review at least ten (10) working days before test materials are prepared for distribution to candidates. Any grievance relating to test construction or training of candidates, as provided in Section 15.4, must be filed within five (5) working days of the date final copies of the test materials and training materials and program are received by the Lodge's ’s testing consultant(s). It is understood that final copies of the training material and program may be provided prior to submission of the final copies of the test materials, so that training of candidates can commence while final test construction is being completed, in which case any grievance regarding the training materials and program must be filed within five (5) working days of the date those documents are received by the Lodge's ’s testing consultant(s). (3) Only those items related to the grievance shall be stayed pending the outcome of the grievance/arbitration. (4) The filing or processing of a grievance/arbitration shall not preclude the Commission from proceeding with test construction or test administration work that is not affected by and/or related to the grievance/arbitration. (5) Notwithstanding the listing of specific times in paragraphs (D)(1) and (D)(2) of this Section within which grievances may be filed, the Lodge is not precluded from filing a grievance as to the violation of any other specific Section of this Article, provided that such grievance is filed within ten (10) working days after such alleged violation becomes known to the Lodge, pursuant to the procedure provided in Section 15.4. However, no grievance shall be filed after certification of the eligible list. The eligible list shall not be certified until at least ten (10) working days after the first date of publication of the tentative eligible list or two (2) working days after any protest decisions have been received by a protesting member, whichever date is later. (6) The Commission shall provide, for continued test assessment and improvement, access to data files from which the Lodge's testing consultant(s) can perform statistical analyses of test results. The Lodge's testing consultant(s) shall provide the Commission with copies of any formal analyses or reports on test results. The Commission shall also provide to the Lodge's testing consultant(s), for continued test assessment and improvement, item analyses and other statistical analyses that the Commission performs except when such analyses are performed at the request of the City Attorney's Office.

Promotional Examination Procedure. (A) The Commission intends to continue to administer four (4) part promotional examinations for the ranks of Police Sergeant and Police Lieutenant. These examinations shall consist of the following: (1) an open-book multiple-choice examination; (2) a closed-book multiple-choice examination; (3) a work sample component; and (4) an oral board component. The Commission intends to administer a two-part promotional examination for the rank of Police Commander. This examination shall consist of the following: (1) a work sample component; and (2) an oral board component. The Lodge's testing experts shall be provided a draft and a final copy of each part of all promotional examinations, together with the weightings for each part based on current (B) The development of certain test administration policies and procedures shall be discussed by a joint committee comprised of members appointed by the Commission and the Lodge. (C) The procedures set forth in Section 15.3(A) shall apply to all promotional examinations given, unless the Commission provides the Lodge notice of intent to change parts of the examination process as specified in Section 15.3(A). Should the Lodge's testing experts be dissatisfied with the Commission's weighting for each examination part, the Lodge's testing experts shall notify the Commission. In either event, the Lodge's testing experts shall be consulted, permitted to participate in discussions with the Commission as to any intended change, and if the Lodge believes that an intended change or the Commission's weighting for each examination part is in conflict with any criteria enumerated in Section 15.1 and/or violates generally accepted professional standards, such proposed change(s) are subject to Sections 15.3(D) and 15.4. (1) The Commission will provide the Lodge's testing consultant(s) with final draft copies of the job analysis and the proposed test plan for the test development process together with documentation used by the Commission in completing these phases. The "test plan" shall include plans for: pretest candidate training, collection of content validity data, collection of other validity data (if used), documentation of validity including mapping back procedures, training for all subject matter experts (SME's), criteria for selection and training of panel members, determination of the test components and their content, the system to be used to combine scores from the phases to obtain the total examination score, and a tentative schedule of dates including the target dates the LodgeXxxxx's testing consultant(s) should be provided with the draft and final copies of the job analysis, test plan, documentation, the target dates for test administration and test results release procedure. The Lodge's testing consultant(s) shall submit their comments, if any, to the Commission on the final draft copies of the job analysis and test plan within ten (10) working days of their receipt of these materials. Thereafter, the Commission shall provide to the Lodge's testing consultant(s) final copies of the job analysis and test plan. Any grievance relating to the job analysis or test plan as provided in Section 15.4 must be filed within five (5) working days of the date these final copies were received by the Lodge's testing consultant(s). (2) The Commission will provide the LodgeXxxxx's testing consultant(s) with final draft copies of each test phase and training objectives and materials, together with documentation used by the Commission in developing the test and pretest candidate training objectives and materials. Such documentation and test materials include test instructions, reading lists, test content, scoring keys, rating scales, scoring procedures, and test administration policies and procedures. These final draft test materials and access to related documentation shall be provided to the Lodge's testing consultant(s) at least ten (10) working days before test materials are put into final form. The Commission shall provide to the Lodge's testing consultant(s) final copies of test materials for review at least ten (10) working days before test materials are prepared for distribution to candidates. Any grievance relating to test construction or training of candidates, as provided in Section 15.4, must be filed within five (5) working days of the date final copies of the test materials and training materials and program are received by the Lodge's testing consultant(s). It is understood that final copies of the training material and program may be provided prior to submission of the final copies of the test materials, so that training of candidates can commence while final test construction is being completed, in which case any grievance regarding the training materials and program must be filed within five (5) working days of the date those documents are received by the LodgeXxxxx's testing consultant(s). (3) Only those items related to the grievance shall be stayed pending the outcome of the grievance/arbitration. (4) The filing or processing of a grievance/arbitration shall not preclude the Commission from proceeding with test construction or test administration work that is not affected by and/or related to the grievance/arbitration. (5) Notwithstanding the listing of specific times in paragraphs (D)(1) and (D)(2) of this Section within which grievances may be filed, the Lodge is not precluded from filing a grievance as to the violation of any other specific Section of this Article, provided that such grievance is filed within ten (10) working days after such alleged violation becomes known to the Lodge, pursuant to the procedure provided in Section 15.4. However, no grievance shall be filed after certification of the eligible list. The eligible list shall not be certified until at least ten (10) working days after the first date of publication of the tentative eligible list or two (2) working days after any protest decisions have been received by a protesting member, whichever date is later. (6) The Commission shall provide, for continued test assessment and improvement, access to data files from which the Lodge's testing consultant(s) can perform statistical analyses of test results. The Lodge's testing consultant(s) shall provide the Commission with copies of any formal analyses or reports on test results. The Commission shall also provide to the Lodge's testing consultant(s), for continued test assessment and improvement, item analyses and other statistical analyses that the Commission performs except when such analyses are performed at the request of the City Attorney's Office.

Promotional Examination Procedure. (A) The Commission intends to continue to administer four (4) part promotional examinations for the ranks of Police Sergeant and Police Lieutenant. These examinations shall consist of the following: (1) an open-book multiple-choice examination; (2) a closed-book multiple-choice examination; (3) a work sample component; and (4) an oral board component. The Commission intends to administer a two-part promotional examination for the rank of Police Commander. This examination shall consist of the following: (1) a work sample component; and (2) an oral board component. The Lodge's testing experts shall be provided a draft and a final copy of each part of all promotional examinations, together with the weightings for each part based on currentchoice (B) The development of certain test administration policies and procedures shall be discussed by a joint committee comprised of members appointed by the Commission and the Lodge. (C) The procedures set forth in Section 15.3(A) shall apply to all promotional examinations given, unless the Commission provides the Lodge notice of intent to change parts of the examination process as specified in Section 15.3(A). Should the Lodge's testing experts be dissatisfied with the Commission's weighting for each examination part, the Lodge's testing experts shall notify the Commission. In either event, the Lodge's testing experts shall be consulted, permitted to participate in discussions with the Commission as to any intended change, and if the Lodge believes that an intended change or the Commission's weighting for each examination part is in conflict with any criteria enumerated in Section 15.1 and/or violates generally accepted professional standards, such proposed change(s) are subject to Sections 15.3(D) and 15.4. (1) The Commission will provide the Lodge's testing consultant(s) with final draft copies of the job analysis and the proposed test plan for the test development process together with documentation used by the Commission in completing these phases. The "test plan" shall include plans for: pretest candidate training, collection of content validity data, collection of other validity data (if used), documentation of validity including mapping back procedures, training for all subject matter experts (SME's), criteria for selection and training of panel members, determination of the test components and their content, the system to be used to combine scores from the phases to obtain the total examination score, and a tentative schedule of dates including the target dates the LodgeXxxxx's testing consultant(s) should be provided with the draft and final copies of the job analysis, test plan, documentation, the target dates for test administration and test results release procedure. The Lodge's testing consultant(s) shall submit their comments, if any, to the Commission on the final draft copies of the job analysis and test plan within ten (10) working days of their receipt of these materials. Thereafter, the Commission shall provide to the Lodge's testing consultant(s) final copies of the job analysis and test plan. Any grievance relating to the job analysis or test plan as provided in Section 15.4 must be filed within five (5) working days of the date these final copies were received by the Lodge's testing consultant(s).if (2) The Commission will provide the LodgeXxxxx's testing consultant(s) with final draft copies of each test phase and training objectives and materials, together with documentation used by the Commission in developing the test and pretest candidate training objectives and materials. Such documentation and test materials include test instructions, reading lists, test content, scoring keys, rating scales, scoring procedures, and test administration policies and procedures. These final draft test materials and access to related documentation shall be provided to the Lodge's testing consultant(s) at least ten (10) working days before test materials are put into final form. The Commission shall provide to the Lodge's testing consultant(s) final copies of test materials for review at least ten (10) working days before test materials are prepared for distribution to candidates. Any grievance relating to test construction or training of candidates, as provided in Section 15.4, must be filed within five (5) working days of the date final copies of the test materials and training materials and program are received by the Lodge's testing consultant(s). It is understood that final copies of the training material and program may be provided prior to submission of the final copies of the test materials, so that training of candidates can commence while final test construction is being completed, in which case any grievance regarding the training materials and program must be filed within five (5) working days of the date those documents are received by the LodgeXxxxx's testing consultant(s). (3) Only those items related to the grievance shall be stayed pending the outcome of the grievance/arbitration. (4) The filing or processing of a grievance/arbitration shall not preclude the Commission from proceeding with test construction or test administration work that is not affected by and/or related to the grievance/arbitration. (5) Notwithstanding the listing of specific times in paragraphs (D)(1) and (D)(2) of this Section within which grievances may be filed, the Lodge is not precluded from filing a grievance as to the violation of any other specific Section of this Article, provided that such grievance is filed within ten (10) working days after such alleged violation becomes known to the Lodge, pursuant to the procedure provided in Section 15.4. However, no grievance shall be filed after certification of the eligible list. The eligible list shall not be certified until at least ten (10) working days after the first date of publication of the tentative eligible list or two (2) working days after any protest decisions have been received by a protesting member, whichever date is later. (6) The Commission shall provide, for continued test assessment and improvement, access to data files from which the Lodge's testing consultant(s) can perform statistical analyses of test results. The Lodge's testing consultant(s) shall provide the Commission with copies of any formal analyses or reports on test results. The Commission shall also provide to the Lodge's testing consultant(s), for continued test assessment and improvement, item analyses and other statistical analyses that the Commission performs except when such analyses are performed at the request of the City Attorney's Office.

Promotional Examination Procedure. (A) The Commission intends to continue to administer four (4) part promotional examinations for the ranks of Police Sergeant and Police Lieutenant. These examinations shall consist of the following: (1) an open-book multiple-choice examination; (2) a closed-book multiple-choice examination; (3) a work sample component; and (4) an oral board component. The Commission intends to administer a two-part promotional examination for the rank of Police Commander. This examination shall consist of the following: (1) a work sample component; and (2) an oral board component. The Lodge's testing experts shall be provided a draft and a final copy of each part of all promotional examinations, together with the weightings for each part based on currentchoice (B) The development of certain test administration policies and procedures shall be discussed by a joint committee comprised of members appointed by the Commission and the Lodge. (C) The procedures set forth in Section 15.3(A) shall apply to all promotional examinations given, unless the Commission provides the Lodge notice of intent to change parts of the examination process as specified in Section 15.3(A). Should the Lodge's testing experts be dissatisfied with the Commission's weighting for each examination part, the Lodge's testing experts shall notify the Commission. In either event, the Lodge's testing experts shall be consulted, permitted to participate in discussions with the Commission as to any intended change, and if the Lodge believes that an intended change or the Commission's weighting for each examination part is in conflict with any criteria enumerated in Section 15.1 and/or violates generally accepted professional standards, such proposed change(s) are subject to Sections 15.3(D) and 15.4. (1) The Commission will provide the Lodge's testing consultant(s) with final draft copies of the job analysis and the proposed test plan for the test development process together with documentation used by the Commission in completing these phases. The "test plan" shall include plans for: pretest candidate training, collection of content validity data, collection of other validity data (if used), documentation of validity including mapping back procedures, training for all subject matter experts (SME's), criteria for selection and training of panel members, determination of the test components and their content, the system to be used to combine scores from the phases to obtain the total examination score, and a tentative schedule of dates including the target dates the Lodge's testing consultant(s) should be provided with the draft and final copies of the job analysis, test plan, documentation, the target dates for test administration and test results release procedure. The Lodge's testing consultant(s) shall submit their comments, if any, to the Commission on the final draft copies of the job analysis and test plan within ten (10) working days of their receipt of these materials. Thereafter, the Commission shall provide to the Lodge's testing consultant(s) final copies of the job analysis and test plan. Any grievance relating to the job analysis or test plan as provided in Section 15.4 must be filed within five (5) working days of the date these final copies were received by the Lodge's testing consultant(s).if (2) The Commission will provide the Lodge's testing consultant(s) with final draft copies of each test phase and training objectives and materials, together with documentation used by the Commission in developing the test and pretest candidate training objectives and materials. Such documentation and test materials include test instructions, reading lists, test content, scoring keys, rating scales, scoring procedures, and test administration policies and procedures. These final draft test materials and access to related documentation shall be provided to the Lodge's testing consultant(s) at least ten (10) working days before test materials are put into final form. The Commission shall provide to the Lodge's testing consultant(s) final copies of test materials for review at least ten (10) working days before test materials are prepared for distribution to candidates. Any grievance relating to test construction or training of candidates, as provided in Section 15.4, must be filed within five (5) working days of the date final copies of the test materials and training materials and program are received by the Lodge's testing consultant(s). It is understood that final copies of the training material and program may be provided prior to submission of the final copies of the test materials, so that training of candidates can commence while final test construction is being completed, in which case any grievance regarding the training materials and program must be filed within five (5) working days of the date those documents are received by the Lodge's testing consultant(s). (3) Only those items related to the grievance shall be stayed pending the outcome of the grievance/arbitration. (4) The filing or processing of a grievance/arbitration shall not preclude the Commission from proceeding with test construction or test administration work that is not affected by and/or related to the grievance/arbitration. (5) Notwithstanding the listing of specific times in paragraphs (D)(1) and (D)(2) of this Section within which grievances may be filed, the Lodge is not precluded from filing a grievance as to the violation of any other specific Section of this Article, provided that such grievance is filed within ten (10) working days after such alleged violation becomes known to the Lodge, pursuant to the procedure provided in Section 15.4. However, no grievance shall be filed after certification of the eligible list. The eligible list shall not be certified until at least ten (10) working days after the first date of publication of the tentative eligible list or two (2) working days after any protest decisions have been received by a protesting member, whichever date is later. (6) The Commission shall provide, for continued test assessment and improvement, access to data files from which the Lodge's testing consultant(s) can perform statistical analyses of test results. The Lodge's testing consultant(s) shall provide the Commission with copies of any formal analyses or reports on test results. The Commission shall also provide to the Lodge's testing consultant(s), for continued test assessment and improvement, item analyses and other statistical analyses that the Commission performs except when such analyses are performed at the request of the City Attorney's Office.

Promotional Examination Procedure. (A) The Commission intends to continue to administer four (4) part promotional examinations for the ranks of Police Sergeant and Police Lieutenant. These examinations shall consist of the following: (1) an open-book multiple-choice examination; (2) a closed-book multiple-choice examination; (3) a work sample component; and (4) an oral board component. The Commission intends to administer a two-part promotional examination for the rank of Police Commander. This examination shall consist of the following: (1) a work sample component; and (2) an oral board component. The Lodge's testing experts shall be provided a draft and a final copy of each part of all promotional examinations, together with the weightings for each part based on currentcurrent job analyses, prior to administration thereof, for review and comment, as provided in this Section 15.3. (B) The development of certain test administration policies and procedures shall be discussed by a joint committee comprised of members appointed by the Commission and the Lodge. (C) The procedures set forth in Section 15.3(A) shall apply to all promotional examinations given, unless the Commission provides the Lodge notice of intent to change parts of the examination process as specified in Section 15.3(A). Should the Lodge's testing experts be dissatisfied with the Commission's weighting for each examination part, the Lodge's testing experts shall notify the Commission. In either event, the Lodge's testing experts shall be consulted, permitted to participate in discussions with the Commission as to any intended change, and if the Lodge believes that an intended change or the Commission's weighting for each examination part is in conflict with any criteria enumerated in Section 15.1 and/or violates generally accepted professional standards, such proposed change(s) are subject to Sections 15.3(D) and 15.4. (1) The Commission will provide the Lodge's testing consultant(s) with final draft copies of the job analysis and the proposed test plan for the test development process together with documentation used by the Commission in completing these phases. The "test plan" shall include plans for: pretest candidate training, collection of content validity data, collection of other validity data (if used), documentation of validity including mapping back procedures, training for all subject matter experts (SME's), criteria for selection and training of panel members, determination of the test components and their content, the system to be used to combine scores from the phases to obtain the total examination score, and a tentative schedule of dates including the target dates the Lodge's testing consultant(s) should be provided with the draft and final copies of the job analysis, test plan, documentation, the target dates for test administration and test results release procedure. The Lodge's testing consultant(s) shall submit their comments, if any, to the Commission on the final draft copies of the job analysis and test plan within ten (10) working days of their receipt of these materials. Thereafter, the Commission shall provide to the Lodge's testing consultant(s) final copies of the job analysis and test plan. Any grievance relating to the job analysis or test plan as provided in Section 15.4 must be filed within five (5) working days of the date these final copies were received by the Lodge's testing consultant(s). (2) The Commission will provide the Lodge's testing consultant(s) with final draft copies of each test phase and training objectives and materials, together with documentation used by the Commission in developing the test and pretest candidate training objectives and materials. Such documentation and test materials include test instructions, reading lists, test content, scoring keys, rating scales, scoring procedures, and test administration policies and procedures. These final draft test materials and access to related documentation shall be provided to the Lodge's testing consultant(s) at least ten (10) working days before test materials are put into final form. The Commission shall provide to the Lodge's testing consultant(s) final copies of test materials for review at least ten (10) working days before test materials are prepared for distribution to candidates. Any grievance relating to test construction or training of candidates, as provided in Section 15.4, must be filed within five (5) working days of the date final copies of the test materials and training materials and program are received by the Lodge's testing consultant(s). It is understood that final copies of the training material and program may be provided prior to submission of the final copies of the test materials, so that training of candidates can commence while final test construction is being completed, in which case any grievance regarding the training materials and program must be filed within five (5) working days of the date those documents are received by the Lodge's testing consultant(s). (3) Only those items related to the grievance shall be stayed pending the outcome of the grievance/arbitration. (4) The filing or processing of a grievance/arbitration shall not preclude the Commission from proceeding with test construction or test administration work that is not affected by and/or related to the grievance/arbitration. (5) Notwithstanding the listing of specific times in paragraphs (D)(1) and (D)(2) of this Section within which grievances may be filed, the Lodge is not precluded from filing a grievance as to the violation of any other specific Section of this Article, provided that such grievance is filed within ten (10) working days after such alleged violation becomes known to the Lodge, pursuant to the procedure provided in Section 15.4. However, no grievance shall be filed after certification of the eligible list. The eligible list shall not be certified until at least ten (10) working days after the first date of publication of the tentative eligible list or two (2) working days after any protest decisions have been received by a protesting member, whichever date is later. (6) The Commission shall provide, for continued test assessment and improvement, access to data files from which the Lodge's testing consultant(s) can perform statistical analyses of test results. The Lodge's testing consultant(s) shall provide the Commission with copies of any formal analyses or reports on test results. The Commission shall also provide to the Lodge's testing consultant(s), for continued test assessment and improvement, item analyses and other statistical analyses that the Commission performs except when such analyses are performed at the request of the City Attorney's Office.

Promotional Examination Procedure. (A) The Commission intends to continue to administer four (4) part promotional examinations for the ranks of Police Sergeant and Police Lieutenant. These examinations shall consist of the following: (1) an open-book multiple-choice examination; (2) a closed-book multiple-multiple- choice examination; (3) a work sample component; and (4) an oral board component. The Commission intends to administer a two-part promotional examination for the rank of Police Commander. This examination shall consist of the following: (1) a work sample component; and (2) an oral board component. The Lodge's ’s testing experts shall be provided a draft and a final copy of each part of all promotional examinations, together with the weightings for each part based on currentcurrent job analyses, prior to administration thereof, for review and comment, as provided in this Section 15.3. (B) The development of certain test administration policies and procedures shall be discussed by a joint committee comprised of members appointed by the Commission and the Lodge. (C) The procedures set forth in Section 15.3(A) shall apply to all promotional examinations given, unless the Commission provides the Lodge notice of intent to change parts of the examination process as specified in Section 15.3(A). Should the Lodge's ’s testing experts be dissatisfied with the Commission's ’s weighting for each examination part, the Lodge's ’s testing experts shall notify the Commission. In either event, the Lodge's ’s testing experts shall be consulted, permitted to participate in discussions with the Commission as to any intended change, and if the Lodge believes that an intended change or the Commission's weighting for each examination part is in conflict with any criteria enumerated in Section 15.1 and/or violates generally accepted professional standards, such proposed change(s) are subject to Sections 15.3(D) and 15.4.Police Contract Negotiations Toolkit: Columbus 69 (1) The Commission will provide the Lodge's ’s testing consultant(s) with final draft copies of the job analysis and the proposed test plan for the test development process together with documentation used by the Commission in completing these phases. The "“test plan" ” shall include plans for: pretest candidate training, collection of content validity data, collection of other validity data (if used), documentation of validity including mapping back procedures, training for all subject matter experts (SME's’s), criteria for selection and training of panel members, determination of the test components and their content, the system to be used to combine scores from the phases to obtain the total examination score, and a tentative schedule of dates including the target dates the Lodge's Xxxxx’s testing consultant(s) should be provided with the draft and final copies of the job analysis, test plan, documentation, the target dates for test administration and test results release procedure. The Lodge's ’s testing consultant(s) shall submit their comments, if any, to the Commission on the final draft copies of the job analysis and test plan within ten (10) working days of their receipt of these materials. Thereafter, the Commission shall provide to the Lodge's ’s testing consultant(s) final copies of the job analysis and test plan. Any grievance relating to the job analysis or test plan as provided in Section 15.4 must be filed within five (5) working days of the date these final copies were received by the Lodge's ’s testing consultant(s). (2) The Commission will provide the Lodge's ’s testing consultant(s) with final draft copies of each test phase and training objectives and materials, together with documentation used by the Commission in developing the test and pretest candidate training objectives and materials. Such documentation and test materials include test instructions, reading lists, test content, scoring keys, rating scales, scoring procedures, and test administration policies and procedures. These final draft test materials and access to related documentation shall be provided to the Lodge's ’s testing consultant(s) at least ten (10) working days before test materials are put into final form. The Commission shall provide to the Lodge's ’s testing consultant(s) final copies of test materials for review at least ten (10) working days before test materials are prepared for distribution to candidates. Any grievance relating to test construction or training of candidates, as provided in Section 15.4, must be filed within five (5) working days of the date final copies of the test materials and training materials and program are received by the Lodge's ’s testing consultant(s). It is understood that final copies of the training material and program may be provided prior to submission of the final copies of the test materials, so that training of candidates can commence while final test construction is being completed, in which case any grievance regarding the training materials and program must be filed within five (5) working days of the date those documents are received by the Lodge's ’s testing consultant(s). (3) Only those items related to the grievance shall be stayed pending the outcome of the grievance/arbitration. (4) The filing or processing of a grievance/arbitration shall not preclude the Commission from proceeding with test construction or test administration work that is not affected by and/or related to the grievance/arbitration. (5) Notwithstanding the listing of specific times in paragraphs (D)(1) and (D)(2) of this Section within which grievances may be filed, the Lodge is not precluded from filing a grievance as to the violation of any other specific Section of this Article, provided that such grievance is filed within ten (10) working days after such alleged violation becomes known to the Lodge, pursuant to the procedure provided in Section 15.4. However, no grievance shall be filed after certification of the eligible list. The eligible list shall not be certified until at least ten (10) working days after the first date of publication of the tentative eligible list or two (2) working days after any protest decisions have been received by a protesting member, whichever date is later. (6) The Commission shall provide, for continued test assessment and improvement, access to data files from which the Lodge's testing consultant(s) can perform statistical analyses of test results. The Lodge's testing consultant(s) shall provide the Commission with copies of any formal analyses or reports on test results. The Commission shall also provide to the Lodge's testing consultant(s), for continued test assessment and improvement, item analyses and other statistical analyses that the Commission performs except when such analyses are performed at the request of the City Attorney's Office.