Using Crowd Agreement for Wordnet LocalizationCrowd Agreement for Wordnet Localization • February 14th, 2018 • Ulaanbaatar
Contract Type FiledFebruary 14th, 2018 JurisdictionBuilding a wordnet from scratch is a huge task, especially for languages less equipped with pre-existing lexical resources such as thesauri or bilingual dictionaries. We address the issue of costliness of human supervision through crowdsourcing that offers a good trade-off between quality of output and speed of progress. In this paper, we demonstrate a two-phase crowdsourcing workflow that consists of a synset localization step followed by a validation step. Validation is performed using the inter-rater agreement metrics Fleiss’ kappa and Krippendorf’s alpha, which allow us to estimate the precision of the result, as well as to set a balance between precision and recall. In our experiment, 947 synsets were localized from English to Mongolian and evaluated through crowdsourcing with the precision of 0.74.
PROGRAM IMPLEMENTATION AGREEMENT BETWEENProgram Implementation Agreement • March 6th, 2019 • Ulaanbaatar
Contract Type FiledMarch 6th, 2019 JurisdictionThis PROGRAM IMPLEMENTATION AGREEMENT (this “Agreement”) is between the United States of America, acting through the Millennium Challenge Corporation, a United States government corporation (“MCC”), and the Government of Mongolia, acting through its Ministry of Foreign Affairs (“Mongolia” or the “Government”) (individually, a “Party” and collectively, the “Parties”).