Evaluation of experiments with NER-based re-ranking Sample Clauses

Evaluation of experiments with NER-based re-ranking. We have tested different re-ranking strategies in the two evaluation datasets: the Xxxx- Xxxx news corpus and the #Microposts2014 tweets corpus. Table 1 shows some of the results we obtained. The first row shows the precision and recall attained by DBSpotlight, with no confidence threshold specified. In this baseline case, precision is lowest and recall is highest. DBSpotlight 0.2546 0.7477 0.3799 0.7272 DBSpotlight (c > 0.9) 0.3002 0.6871 0.4178 0.7639 Re-ranked DBSpotlight 0.2546 0.7477 0.3799 0.6979 Re-ranked DBSpotlight (c > 0.9) 0.3140 0.7342 0.4399 0.7369 The other rows combine a confidence threshold of 0.93 with the re-ranking heuristics explained above. The best F-measure (0.4399) in detection is attained with c>0.9 and re-ranking. However the most remarkable result here appears in the third row: re- ranking is actually detrimental to accuracy in classification, while not improving precision and recall in detection. The following example illustrates what is actually happening: Following are highlights of the midday briefing by the European Commission on Wednesday.  Stanford NER correctly annotates European Commission as ORGANISATION.  DBPedia Spotlight provides this ranked list of candidate annotations, with their probabilities. European_Comission (0.9999999995178541) ECHO_(European_Commission) (4.532487558872544E-10) Barroso_Commission (6.689508820986744E-21) Directorate- General_for_Education_and_Culture_(European_Commission) (1.9533030489271525E-22) The good one is, correctly, the first one, but, unfortunately, its dbtype is empty, so the re-ranking strategy incorrectly picks the first one with a dbtype compatible with ORGANISATION (the one in bold).
Sample 1

Related to Evaluation of experiments with NER-based re-ranking

  • Procedures and Presumptions for Determination of Entitlement to Indemnification It is the intent of this Agreement to secure for Indemnitee rights of indemnity that are as favorable as may be permitted under the DGCL and public policy of the State of Delaware. Accordingly, the parties agree that the following procedures and presumptions shall apply in the event of any question as to whether Indemnitee is entitled to indemnification under this Agreement: a. To obtain indemnification under this Agreement, Indemnitee shall submit to the Company a written request, including therein or therewith such documentation and information as is reasonably available to Indemnitee and is reasonably necessary to determine whether and to what extent Indemnitee is entitled to indemnification. The Secretary of the Company shall, promptly upon receipt of such a request for indemnification, advise the Board in writing that Indemnitee has requested indemnification. Notwithstanding the foregoing, any failure of Indemnitee to provide such a request to the Company, or to provide such a request in a timely fashion, shall not relieve the Company of any liability that it may have to Indemnitee unless, and to the extent that, such failure actually and materially prejudices the interests of the Company. b. Upon written request by Indemnitee for indemnification pursuant to the first sentence of Section 6(a) hereof, a determination with respect to Indemnitee’s entitlement thereto shall be made in the specific case by one of the following four methods, which shall be at the election of the Board (1) by a majority vote of the disinterested directors, even though less than a quorum, (2) by a committee of disinterested directors designated by a majority vote of the disinterested directors, even though less than a quorum, (3) if there are no disinterested directors or if the disinterested directors so direct, by independent legal counsel in a written opinion to the Board, a copy of which shall be delivered to the Indemnitee, or (4) if so directed by the Board, by the stockholders of the Company. For purposes hereof, disinterested directors are those members of the Board who are not parties to the action, suit or proceeding in respect of which indemnification is sought by Indemnitee. c. If the determination of entitlement to indemnification is to be made by Independent Counsel pursuant to Section 6(b) hereof, the Independent Counsel shall be selected as provided in this Section 6(c). The Independent Counsel shall be selected by the Board. Indemnitee may, within ten (10) days after such written notice of selection shall have been given, deliver to the Company a written objection to such selection; provided, however, that such objection may be asserted only on the ground that the Independent Counsel so selected does not meet the requirements of “Independent Counsel” as defined in Section 13 of this Agreement, and the objection shall set forth with particularity the factual basis of such assertion. Absent a proper and timely objection, the person so selected shall act as Independent Counsel. If a written objection is made and substantiated, the Independent Counsel selected may not serve as Independent Counsel unless and until such objection is withdrawn or a court has determined that such objection is without merit. If, within twenty (20) days after submission by Indemnitee of a written request for indemnification pursuant to Section 6(a) hereof, no Independent Counsel shall have been selected and not objected to, either the Company or Indemnitee may petition the Court of Chancery of the State of Delaware or other court of competent jurisdiction for resolution of any objection which shall have been made by the Indemnitee to the Company’s selection of Independent Counsel and/or for the appointment as Independent Counsel of a person selected by the court or by such other person as the court shall designate, and the person with respect to whom all objections are so resolved or the person so appointed shall act as Independent Counsel under Section 6(b) hereof. The Company shall pay any and all reasonable fees and expenses of Independent Counsel incurred by such Independent Counsel in connection with acting pursuant to Section 6(b) hereof, and the Company shall pay all reasonable fees and expenses incident to the procedures of this Section 6(c), regardless of the manner in which such Independent Counsel was selected or appointed. d. In making a determination with respect to entitlement to indemnification hereunder, the person or persons or entity making such determination shall presume that Indemnitee is entitled to indemnification under this Agreement. Anyone seeking to overcome this presumption shall have the burden of proof and the burden of persuasion by clear and convincing evidence. Neither the failure of the Company (including by its directors or independent legal counsel) to have made a determination prior to the commencement of any action pursuant to this Agreement that indemnification is proper in the circumstances because Indemnitee has met the applicable standard of conduct, nor an actual determination by the Company (including by its directors or independent legal counsel) that Indemnitee has not met such applicable standard of conduct, shall be a defense to the action or create a presumption that Indemnitee has not met the applicable standard of conduct. e. Indemnitee shall be deemed to have acted in good faith if Indemnitee’s action is based on the records or books of account of the Enterprise (as hereinafter defined), including financial statements, or on information supplied to Indemnitee by the officers of the Enterprise in the course of their duties, or on the advice of legal counsel for the Enterprise or on information or records given or reports made to the Enterprise by an independent certified public accountant or by an appraiser or other expert selected with reasonable care by the Enterprise. In addition, the knowledge and/or actions, or failure to act, of any director, officer, agent or employee of the Enterprise shall not be imputed to Indemnitee for purposes of determining the right to indemnification under this Agreement. Whether or not the foregoing provisions of this Section 6(e) are satisfied, it shall in any event be presumed that Indemnitee has at all times acted in good faith and in a manner he reasonably believed to be in or not opposed to the best interests of the Company. Anyone seeking to overcome this presumption shall have the burden of proof and the burden of persuasion by clear and convincing evidence. f. If the person, persons or entity empowered or selected under Section 6 to determine whether Indemnitee is entitled to indemnification shall not have made a determination within sixty (60) days after receipt by the Company of the request therefor, the requisite determination of entitlement to indemnification shall be deemed to have been made and Indemnitee shall be entitled to such indemnification absent (i) a misstatement by Indemnitee of a material fact, or an omission of a material fact necessary to make Indemnitee’s statement not materially misleading, in connection with the request for indemnification, or (ii) a prohibition of such indemnification under applicable law; provided, however, that such sixty (60) day period may be extended for a reasonable time, not to exceed an additional thirty (30) days, if the person, persons or entity making such determination with respect to entitlement to indemnification in good faith requires such additional time to obtain or evaluate documentation and/or information relating thereto. g. Indemnitee shall cooperate with the person, persons or entity making such determination with respect to Indemnitee’s entitlement to indemnification, including providing to such person, persons or entity upon reasonable advance request any documentation or information which is not privileged or otherwise protected from disclosure and which is reasonably available to Indemnitee and reasonably necessary to such determination. Any Independent Counsel, member of the Board or stockholder of the Company shall act reasonably and in good faith in making a determination regarding the Indemnitee’s entitlement to indemnification under this Agreement. Any costs or expenses (including attorneys’ fees and disbursements) incurred by Indemnitee in so cooperating with the person, persons or entity making such determination shall be borne by the Company (irrespective of the determination as to Indemnitee’s entitlement to indemnification) and the Company hereby indemnifies and agrees to hold Indemnitee harmless therefrom. h. The Company acknowledges that a settlement or other disposition short of final judgment may be successful if it permits a party to avoid expense, delay, distraction, disruption and uncertainty. In the event that any action, claim or proceeding to which Indemnitee is a party is resolved in any manner other than by adverse judgment against Indemnitee (including, without limitation, settlement of such action, claim or proceeding with or without payment of money or other consideration) it shall be presumed that Indemnitee has been successful on the merits or otherwise in such action, suit or proceeding. Anyone seeking to overcome this presumption shall have the burden of proof and the burden of persuasion by clear and convincing evidence. i. The termination of any Proceeding or of any claim, issue or matter therein, by judgment, order, settlement or conviction, or upon a plea of nolo contendere or its equivalent, shall not (except as otherwise expressly provided in this Agreement) of itself adversely affect the right of Indemnitee to indemnification or create a presumption that Indemnitee did not act in good faith and in a manner which he reasonably believed to be in or not opposed to the best interests of the Company or, with respect to any criminal Proceeding, that Indemnitee had reasonable cause to believe that his conduct was unlawful.

  • Independent Evaluation Buyer is an experienced and knowledgeable investor in the oil and gas business. Buyer has been advised by and has relied solely on its own expertise and legal, tax, title, reservoir engineering, environmental and other professional counsel concerning this transaction, the Properties, the value thereof and title thereto.

  • Evaluation Cycle Goal Setting and Development of the Educator Plan A) Every Educator has an Educator Plan that includes, but is not limited to, one goal related to the improvement of practice; one goal for the improvement of student learning. The Plan also outlines actions the Educator must take to attain the goals established in the Plan and benchmarks to assess progress. Goals may be developed by individual Educators, by the Evaluator, or by teams, departments, or groups of Educators who have the similar roles and/or responsibilities. See Sections 15-19 for more on Educator Plans. B) To determine the goals to be included in the Educator Plan, the Evaluator reviews the goals the Educator has proposed in the Self-Assessment, using evidence of Educator performance and impact on student learning, growth and achievement based on the Educator’s self-assessment and other sources that Evaluator shares with the Educator. The process for determining the Educator’s impact on student learning, growth and achievement will be determined after ESE issues guidance on this matter. See #22, below. C) Educator Plan Development Meetings shall be conducted as follows: i) Educators in the same school may meet with the Evaluator in teams and/or individually at the end of the previous evaluation cycle or by October 15th of the next academic year to develop their Educator Plan. Educators shall not be expected to meet during the summer hiatus. ii) For those Educators new to the school, the meeting with the Evaluator to establish the Educator Plan must occur by October 15th or within six weeks of the start of their assignment in that school iii) The Evaluator shall meet individually with Educators with PTS and ratings of needs improvement or unsatisfactory to develop professional practice goal(s) that must address specific standards and indicators identified for improvement. In addition, the goals may address shared grade level or subject matter goals. D) The Evaluator completes the Educator Plan by November 1st. The Educator shall sign the Educator Plan within 5 school days of its receipt and may include a written response. The Educator’s signature indicates that the Educator received the plan in a timely fashion. The signature does not indicate agreement or disagreement with its contents. The Evaluator retains final authority over the content of the Educator’s Plan.

  • Evaluation of Students Acknowledging the District’s adopted grading system, the teacher shall maintain the right and responsibility to determine grades and other evaluation of a student. No grade or evaluation shall be changed except by the teacher with the approval of the building administrator.

  • Procedure for Third Party Claims The obligations and liabilities of each Party with respect to Third-Party Claims shall be subject to the following terms and conditions: (i) Promptly upon receiving a written notice of a Third-Party Claim, the Indemnifying Party may elect, at its sole option, to undertake the defense thereof by outside counsel of its own choosing, which outside counsel shall be reasonably satisfactory to the Indemnified Party, by sending written notice of its election to the Indemnified Party; provided however, that if, in the Indemnified Party’s and the Indemnifying Party’s reasonable judgment, a conflict of interest exists between the Indemnified Party and the Indemnifying Party with respect to such Third-Party Claim, or if the Indemnifying Party elects not to defend or otherwise does not promptly defend such Third-Party Claim, such Indemnified Party shall be entitled to undertake the defense of, and to compromise or settle, such Third-Party Claim on behalf, for the account, and at the risk of the Indemnifying Party, to the extent that the Indemnifying Party is determined to be obligated to indemnify the Indemnified Party under this Agreement with respect to such Third-Party Claim. The written notice of the Third-Party Claim shall contain all material information known to the Indemnified Party with respect to such Third-Party Claim and shall include copies of materials submitted to Indemnified Party by the Third-Party with respect to such Third-Party Claim. (ii) If the Indemnifying Party elects to undertake and diligently pursue the defense of a Third-Party Claim hereunder, the Indemnifying Party shall control all aspects of the defense and settlement of such Third-Party Claim and may settle, compromise or enter into a judgment with respect to such Third-Party Claim; provided that the Indemnifying Party shall not enter into any such settlement, compromise or judgment without the prior written consent of the Indemnified Party if such settlement, compromise or judgment would result in the imposition of any non-monetary liability or obligation on the Indemnified Party. If the Indemnifying Party assumes control of the defense under this Article 9, the Indemnified Party shall fully cooperate with the Indemnifying Party in connection therewith and may employ, at any time, a separate outside counsel to represent it; provided however, that the Indemnified Party shall be solely responsible for the costs and expenses of any such separate outside counsel. If the Indemnified Party undertakes the defense of a Third-Party Claim hereunder, the Indemnified Party shall not settle, compromise, or enter into any judgment with respect to such Third-Party Claim for which it is seeking or shall seek indemnification hereunder without the prior written consent of Indemnifying Party, which written consent shall not be unreasonably withheld, conditioned or delayed. (iii) The Indemnified Party shall provide the Indemnifying Party with access to all reasonably requested records and documents of the Indemnified Party relating to any Third-Party Claim, other than documents for which the Indemnified Party has claimed or shall claim a legal privilege.

  • Procedure for Determination of Entitlement to Indemnification (a) To obtain indemnification under this Agreement, Indemnitee shall submit to the Company a written request, including therein or therewith such documentation and information as is reasonably available to Indemnitee and is reasonably necessary to determine whether and to what extent Indemnitee is entitled to indemnification. Indemnitee may submit one or more such requests from time to time and at such time(s) as Indemnitee deems appropriate in Indemnitee’s sole discretion. The officer of the Company receiving any such request from Indemnitee shall, promptly upon receipt of such a request for indemnification, advise the Board of Directors in writing that Indemnitee has requested indemnification. (b) Upon written request by Indemnitee for indemnification pursuant to Section 10(a) above, a determination, if required by applicable law, with respect to Indemnitee’s entitlement thereto shall promptly be made in the specific case: (i) if a Change in Control shall have occurred, by Independent Counsel, in a written opinion to the Board of Directors, a copy of which shall be delivered to Indemnitee, which Independent Counsel shall be selected by Indemnitee and approved by the Board of Directors in accordance with Section 2-418(e)(2)(ii) of the MGCL, which approval shall not be unreasonably withheld; or (ii) if a Change in Control shall not have occurred, (A) by the Board of Directors by a majority vote of a quorum consisting of Disinterested Directors or, if such a quorum cannot be obtained, then by a majority vote of a duly authorized committee of the Board of Directors consisting solely of one or more Disinterested Directors, (B) if Independent Counsel has been selected by the Board of Directors in accordance with Section 2-418(e)(2)(ii) of the MGCL and approved by Indemnitee, which approval shall not be unreasonably withheld, by Independent Counsel, in a written opinion to the Board of Directors, a copy of which shall be delivered to Indemnitee or (C) if so directed by a majority of the members of the Board of Directors, by the stockholders of the Company. If it is so determined that Indemnitee is entitled to indemnification, payment to Indemnitee shall be made within ten days after such determination. Indemnitee shall cooperate with the person, persons or entity making such determination with respect to Indemnitee’s entitlement to indemnification, including providing to such person, persons or entity upon reasonable advance request any documentation or information which is not privileged or otherwise protected from disclosure and which is reasonably available to Indemnitee and reasonably necessary to such determination in the discretion of the Board of Directors or Independent Counsel if retained pursuant to clause (ii)(B) of this Section 10(b). Any Expenses incurred by Indemnitee in so cooperating with the person, persons or entity making such determination shall be borne by the Company (irrespective of the determination as to Indemnitee’s entitlement to indemnification) and the Company shall indemnify and hold Indemnitee harmless therefrom. (c) The Company shall pay the reasonable fees and expenses of Independent Counsel, if one is appointed.

  • Indemnitee Rights on Unfavorable Determination; Binding Effect If any Reviewing Party determines that Indemnitee substantively is not entitled to be indemnified hereunder in whole or in part under applicable law, Indemnitee shall have the right to commence litigation seeking an initial determination by the court or challenging any such determination by such Reviewing Party or any aspect thereof, including the legal or factual bases therefor, and, subject to the provisions of Section 15, the Company hereby consents to service of process and to appear in any such proceeding. Absent such litigation, any determination by any Reviewing Party shall be conclusive and binding on the Company and Indemnitee.

  • Selection of Reviewing Party; Change in Control If there has not been a Change in Control, any Reviewing Party shall be selected by the Board of Directors, and if there has been such a Change in Control (other than a Change in Control which has been approved by a majority of the Company's Board of Directors who were directors immediately prior to such Change in Control), any Reviewing Party with respect to all matters thereafter arising concerning the rights of Indemnitee to indemnification of Expenses under this Agreement or any other agreement or under the Company's Certificate of Incorporation or Bylaws as now or hereafter in effect, or under any other applicable law, if desired by Indemnitee, shall be Independent Legal Counsel selected by Indemnitee and approved by the Company (which approval shall not be unreasonably withheld). Such counsel, among other things, shall render its written opinion to the Company and Indemnitee as to whether and to what extent Indemnitee would be entitled to be indemnified hereunder under applicable law and the Company agrees to abide by such opinion. The Company agrees to pay the reasonable fees of the Independent Legal Counsel referred to above and to indemnify fully such counsel against any and all expenses (including attorneys' fees), claims, liabilities and damages arising out of or relating to this Agreement or its engagement pursuant hereto. Notwithstanding any other provision of this Agreement, the Company shall not be required to pay Expenses of more than one Independent Legal Counsel in connection with all matters concerning a single Indemnitee, and such Independent Legal Counsel shall be the Independent Legal Counsel for any or all other Indemnitees unless (i) the employment of separate counsel by one or more Indemnitees has been previously authorized by the Company in writing, or (ii) an Indemnitee shall have provided to the Company a written statement that such Indemnitee has reasonably concluded that there may be a conflict of interest between such Indemnitee and the other Indemnitees with respect to the matters arising under this Agreement.

  • Services and Information for Persons with Limited English Proficiency A. Grantee shall take reasonable steps to provide services and information both orally and in writing, in appropriate languages other than English, to ensure that persons with limited English proficiency are effectively informed and can have meaningful access to programs, benefits and activities. Meaningful access may entail providing language assistance services, including oral interpretation and written translation, if necessary. More information can be found at xxxxx://xxx.xxx.xxx/. B. Grantee shall identify and document on the client records the primary language/dialect of a client who has limited English proficiency and the need for translation or interpretation services and shall not require a client to provide or pay for the services of a translator or interpreter. C. Grantee shall make every effort to avoid use of any persons under the age of 18 or any family member or friend of the client as an interpreter for essential communications with a client with limited English proficiency, unless the client has requested that person and using the person would not compromise the effectiveness of services or violate the client’s confidentiality and the client is advised that a free interpreter is available.

  • Indemnification Procedure for Third Party Claims (a) In the event that any party (the “Indemnified Person”) desires to make a claim against any other party (the “Indemnifying Person”) in connection with any Losses for which the Indemnified Person may seek indemnification hereunder in respect of a claim or demand made by any Person not a party to this Agreement against the Indemnified Person (a “Third-Party Claim”), such Indemnified Person must notify the Indemnifying Person in writing, of the Third-Party Claim (a “Third-Party Claim Notice”) as promptly as reasonably possible after receipt, but in no event later than fifteen (15) calendar days after receipt, by such Indemnified Person of notice of the Third-Party Claim; provided, that failure to give a Third-Party Claim Notice on a timely basis shall not affect the indemnification provided hereunder except to the extent the Indemnifying Person shall have been actually and materially prejudiced as a result of such failure. Upon receipt of the Third-Party Claim Notice from the Indemnified Person, the Indemnifying Person shall be entitled, at the Indemnifying Person’s election, to assume or participate in the defense of any Third-Party Claim at the cost of Indemnifying Person. In any case in which the Indemnifying Person assumes the defense of the Third-Party Claim, the Indemnifying Person shall give the Indemnified Person ten (10) calendar days’ notice prior to executing any settlement agreement and the Indemnified Person shall have the right to approve or reject the settlement and related expenses; provided, however, that upon rejection of any settlement and related expenses, the Indemnified Person shall assume control of the defense of such Third-Party Claim and the liability of the Indemnifying Person with respect to such Third-Party Claim shall be limited to the amount or the monetary equivalent of the rejected settlement and related expenses. (b) The Indemnified Person shall retain the right to employ its own counsel and to discuss matters with the Indemnifying Person related to the defense of any Third-Party Claim, the defense of which has been assumed by the Indemnifying Person pursuant to Section 10.3(a) of this Agreement, but the Indemnified Person shall bear and shall be solely responsible for its own costs and expenses in connection with such participation; provided, however, that, subject to Section 10.3(a) above, all decisions of the Indemnifying Person shall be final and the Indemnified Person shall cooperate with the Indemnifying Person in all respects in the defense of the Third-Party Claim, including refraining from taking any position adverse to the Indemnifying Person. (c) If the Indemnifying Person fails to give notice of the assumption of the defense of any Third-Party Claim within a reasonable time period not to exceed forty-five (45) days after receipt of the Third-Party Claim Notice from the Indemnified Person, the Indemnifying Person shall no longer be entitled to assume (but shall continue to be entitled to participate in) such defense. The Indemnified Person may, at its option, continue to defend such Third-Party Claim and, in such event, the Indemnifying Person shall indemnify the Indemnified Person for all reasonable fees and expenses in connection therewith (provided it is a Third-Party Claim for which the Indemnifying Person is otherwise obligated to provide indemnification hereunder). The Indemnifying Person shall be entitled to participate at its own expense and with its own counsel in the defense of any Third-Party Claim the defense of which it does not assume. Prior to effectuating any settlement of such Third-Party Claim, the Indemnified Person shall furnish the Indemnifying Person with written notice of any proposed settlement in sufficient time to allow the Indemnifying Person to act thereon. Within fifteen (15) days after the giving of such notice, the Indemnified Person shall be permitted to effect such settlement unless the Indemnifying Person (a) reimburses the Indemnified Person in accordance with the terms of this Article 10 for all reasonable fees and expenses incurred by the Indemnified Person in connection with such Claim; (b) assumes the defense of such Third-Party Claim; and (c) takes such other actions as the Indemnified Person may reasonably request as assurance of the Indemnifying Person’s ability to fulfill its obligations under this Article 10 in connection with such Third-Party Claim.