This page contains a comparison of translation quality of different machine translation services. It is important to notice that this is not an universal ranking of best machine translators. The results are directly applicable only to the given test conditions. Even so, this scoring provides an indicative state of play.

Machine translation quality is a highly controversial topic. There has been a lot of debate around the usefulness of automatic translations. The discussion has got an attitudinal flavor and it has contained plenty of personal views and experiences. All this have made the topic a matter of opinions rather than facts. We hope to add a little more actual data into the conversation with these statistics from our tests.

Results

Test Conditions

The analysis was made using MT-Qualifier, a technology that estimates machine translation quality automatically and without reference translations. MT-Qualifier evaluates the quality of several machine translation services automatically. The quality calculations are made separately for each segment and the overall quality score is the average of these numbers. The analysis contains six, publicly available machine translation services: Apertium, Bing/Microsoft Translator, Google Translate, LinguaTec, Promt and Systran.

The comparison and analysis was made using the data from WMT14 – ACL 2014 Ninth Workshop on Statistical Machine Translation (For more information about the conference and material visit the official website). The material contains a representative collection of many types of texts. The topics include politics and economics. The analysis is based on translations from English to Spanish.

Disclaimer: Machine translation quality is always context-sensitive. The machine translation services included in this analysis may perform very differently with other material or between other languages. Also any possible changes that are made in the technologies may affect the quality. These changes are mostly silent and released without an announcement.

http://mt-quality.multilizer.com/machine-translation-quality-statistics/