Overall Interrater Agreement Sample Clauses

Overall Interrater Agreement. The presentation of our results consists of two elements. First, the computed value of Kappa. Second, the interpretation of the strength of agreement is given. For all values of Kappa that are Study 1 (ENG.3 Process - Develop Software Design) Study 2 (PRO.5 Process - Manage Quality) Proportion Agreement Kappa Interpretation Proportion Agreement Kappa Interpretation Overall (4-Category scale) 77% 0.59 Moderate 78% 0.70 Substantial 3-Category Scale 80% 0.63 Substantial 84% 0.76 Substantial 2-Category Scale 97% 0.92 Almost Perfect 91% 0.79 Substantial Only High Capability Lvls Only Low Capability Lvls 62% 85% 0.46 0.44 Moderate Moderate 69% 85% 0.54 0.72 Moderate Substantial Figure 8: Results from the interrater agreement analysis. presented in this section, we tested the hypothesis that their values were greater than zero. The null hypothesis was rejected in all cases at a one tailed alpha level of 0.05. Initially, values for weighted kappa were calculated. These are 0.92 for study one and 0.88 for study two. These values indicate almost perfect agreement. Therefore, taking the severity of disagreement into account, one can claim that these assessments demonstrated a very high level of agreement between the two teams. This can be explained by the fact that most disagreements were between adjacent categories on the four-point scale. Overall values of unweighted Kappa were then calculated. As can be seen in Figure 8, overall agreement ranges from “moderate” in study 1 to “substantial” in study 2. These levels of interrater agreement both surpass our minimal requirement of being at least "moderate" (statistical test conducted at a one-tailed alpha level of 0.05). Another point to notice is that the difference in the values of Kappa between the two processes is not small. This indicates that interrater agreement is potentially different for different processes. This may be a function of how well the different processes are described in the SPICE documentation and how well they are understood by the assessors in general.
Sample 1
AutoNDA by SimpleDocs

Related to Overall Interrater Agreement

  • Student Agreement The acceptable and unacceptable uses of the Charter School network and the Internet are described in this “Student Acceptable Use Agreement." By signing this agreement, I acknowledge that I have read, understand and agree to abide by the provisions of the attached Student Acceptable Use Policy. I understand that any violations of the above could result in the immediate loss of electronic computing and may result in further disciplinary and/or legal action, including but not limited to suspension, or referral to legal authorities. I also agree to report any misuse of the Charter School network to school site teacher or administrator. Misuse can come in many forms but can be viewed as any messages sent or received that indicate or suggest pornography, unethical or illegal solicitation, racism, sexism, inappropriate language, and other issues described under the unacceptable uses in this Acceptable Use Policy. I realize that all the rules of conduct described in this Charter School Acceptable Use Policy, procedures, and handbooks apply when I am using the Charter School network. Student Name: Student Signature: Date: PARENT OR GUARDIAN AGREEMENT: (Students under the age of 18 must have a parent or guardian who has read and signed this Acceptable Use Contract.) As a parent or guardian of this student, I have read this Acceptable Use Policy and understand that the use of the Charter School network is designated for educational purposes only. I understand that it is impossible for the Charter School to restrict access to all controversial materials, and I will not hold the Charter School, responsible for materials acquired on the Charter School network or Internet. I also agree to report any misuse of these electronic resources to the school administrator. I accept full responsibility for my child should they use remote connections when available to the Charter School network in a non- school setting. I hereby give my permission to issue an account for my child to use the Charter School network and Internet. I release the Charter School, its affiliates and its employees from any claims or damages of any nature arising from my child or dependent’s access and use of the Charter School network. I also agree not to hold the Charter School responsible for materials improperly acquired on the system, or for violations of copyright restrictions, user’s mistakes or negligence, or any costs incurred by users. This agreement shall be governed by and construed under the laws of the United States and the State of California. Student Name: Parent/Legal Guardian Name: Parent/Legal Guardian Signature: Date:

  • Interconnection Agreement On or before December 31, 2015, Wholesale Market Participant must enter into an Interconnection Agreement with the Transmission Owner in order to effectuate the WMPA. Wholesale Market Participant shall demonstrate the occurrence of each of the foregoing milestones to Transmission Provider’s reasonable satisfaction. Transmission Provider may reasonably extend any such milestone dates, in the event of delays that Wholesale Market Participant (i) did not cause and (ii) could not have remedied through the exercise of due diligence. If (i) the Wholesale Market Participant suspends work pursuant to a suspension provision contained in an interconnection and/or construction agreement with the Transmission Owner or (ii) the Transmission Owner extends the date by which Wholesale Market Participant must enter into an interconnection agreement relative to this WMPA, and (iii) the Wholesale Market Participant has not made a wholesale sale under this WMPA, the Wholesale Market Participant may suspend this WMPA by notifying the Transmission Provider and the Transmission Owner in writing that it wishes to suspend this WMPA, with the condition that, notwithstanding such suspension, the Transmission System shall be left in a safe and reliable condition in accordance with Good Utility Practice and Transmission Provider’s safety and reliability criteria. Wholesale Market Participant’s notice of suspension shall include an estimated duration of the suspension period and other information related to the suspension. Pursuant to this section 3.1, Wholesale Market Participant may request one or more suspensions of work under this WMPA for a cumulative period of up to a maximum of three years. If, however, the suspension will result in a Material Modification as defined in Part I, Section 1.18A.02 of the Tariff, then such suspension period shall be no greater than one (1) year. If the Wholesale Market Participant suspends this WMPA pursuant to this Section 3.1 and has not provided written notice that it will exit such suspension on or before the expiration of the suspension period described herein, this WMPA shall be deemed terminated as of the end of such suspension period. The suspension time shall begin on the date the suspension is requested or on the date of the Wholesale Market Participant’s written notice of suspension to Transmission Provider, if no effective date was specified. All milestone dates stated in this Section 3.1 shall be deemed to be extended coextensively with any suspension period permitted pursuant to this provision.

  • Services Agreement “Services Agreement” shall mean any present or future agreements, either written or oral, between Covered Entity and Business Associate under which Business Associate provides services to Covered Entity which involve the use or disclosure of Protected Health Information. The Services Agreement is amended by and incorporates the terms of this BA Agreement.

  • Operating Agreement You haves received and read a copy of the Company’s Operating Agreement (the “Operating Agreement”) and agree that your execution of this Agreement constitutes your consent to and execution of the Operating Agreement, and, that upon acceptance of this Agreement by the Company, you will become a member of the Company as a holder of Shares. When this Agreement is countersigned by the Company, the Operating Agreement shall be binding upon you as of the closing date.

  • Management Agreement The Management Agreement is in full force and effect and there is no default thereunder by any party thereto and no event has occurred that, with the passage of time and/or the giving of notice would constitute a default thereunder.

  • Red Hat Enterprise Linux Developer Suite Red Hat Enterprise Linux Developer Suite provides an open source development environment that consists of Red Hat Enterprise Linux with built-in development tools, certain Red Hat Enterprise Linux Add-Ons, Red Hat Enterprise Linux for Real Time, Smart Management and access to Software Maintenance, but no Development or Production Support. If you use any of the Subscription Services or Software associated with Red Hat Enterprise Linux Developer Suite for Production Purposes, or use the Red Hat Enterprise Linux Software Subscription entitlement independently, you agree to purchase the applicable number of Units of the applicable Software Subscription. Red Hat does not provide Production Support or Development Support for Red Hat Enterprise Developer Suite.

  • Compliance Between Individual Contract and Master Agreement An individual contract between the Board and an individual employee, heretofore or hereafter executed, shall be subject to and consistent with the terms and conditions of this Agreement. If an individual contract contains any language inconsistent with this Agreement, this Agreement during its duration shall be controlling.

  • INDIVIDUAL SERVICES AGREEMENT This contract shall include an Individual Services Agreement (ISA) developed for each LEA pupil to whom CONTRACTOR is to provide special education and/or related services. An ISA shall only be issued for LEA pupils enrolled with the approval of the LEA pursuant to Education Code section 56366 (a)(2)(A). ISAs are void upon termination or expiration of the Master Contract. In the event that this Master Contract expires or terminates, CONTRACTOR and the LEA shall continue to be bound to all of the terms and conditions of the most recent executed ISAs between CONTRACTOR and LEA for so long as CONTRACTOR is servicing authorized LEA pupils, until such time as a new Master Contract is executed. Any and all changes to a LEA pupil’s educational placement/program provided under this Master Contract and/or an ISA shall be made solely on the basis of a revision to the LEA pupil’s IEP/IFSP. At any time during the term of this Master Contract, a LEA pupil’s parent, CONTRACTOR, or XXX may request a review of a LEA pupil’s IEP/IFSP subject to all procedural safeguards required by law, including notice to and participation by the CONTRACTOR in the IEP Team meeting. Unless otherwise provided in this Master Contract, the CONTRACTOR shall provide all services specified in the IEP/IFSP unless the CONTRACTOR and the LEA agree otherwise in the ISA. (California Education Code sections 56366(a) (5) and 3062(e)). In the event the CONTRACTOR is unable to provide a specific service at any time during the term of the ISA, the CONTRACTOR shall notify the LEA in writing within five (5) business days of the last date a service was provided. If a parent or XXX contests the termination of an ISA by initiating a due process proceeding with the California Office of Administrative Hearings (hereinafter referred to as “OAH”), CONTRACTOR shall abide by the “stay- put” requirement of state and federal law unless the parent agrees otherwise or an interim alternative educational placement is deemed lawful and appropriate by LEA or OAH. Disagreements between XXX and CONTRACTOR concerning the formulation of an ISA or the Master Contract may be appealed to the local SELPA office prior to appeal to the State Superintendent of Public Instruction pursuant to the provisions of California Education Code section 56366 (C) (2).

  • Consortium Agreement agreement entered into by and between the Manager and the Contractors, pursuant to Annex X.

  • Enterprise Agreement 1.1 This Enterprise Agreement is made pursuant to the Fair Work Act 1994, Chapter 3, Part 2.

Time is Money Join Law Insider Premium to draft better contracts faster.