Evaluation Scenario Sample Clauses
Evaluation Scenario. For evaluation, a multilingual / machine translation task was selected, to cover as many PANACEA tools as possible. The task was to adapt a baseline system to a new domain. The domain chosen was automotive, the language direction was German to English. The scenario consists in creating a baseline system, in this case a commercial out-of-the-box system was used (Linguatec’s ‘Personal Translator 14’, the most-installed system in the German market (Aleksić & Thurmair 2011). This baseline system should be adapted to the automotive domain, on the one hand by using conventional technology, on the other hand by using PANACEA tools. This is shown in fig. 2-1.
Fig. 2-1: Evaluation scenario The adapted systems should be compared in quality, and the achieved quality should be compared to the effort needed to achieve it.