{"id":8892,"date":"2023-05-24T16:31:13","date_gmt":"2023-05-24T19:31:13","guid":{"rendered":"https:\/\/globaltranslations.com.br\/?p=8892"},"modified":"2023-05-25T15:29:12","modified_gmt":"2023-05-25T18:29:12","slug":"death-by-machine-translation","status":"publish","type":"post","link":"https:\/\/globaltranslations.com.br\/en\/death-by-machine-translation\/","title":{"rendered":"Death by Machine Translation?"},"content":{"rendered":"\n

Machine translation tools like Google Translate can be super handy. But the truth is that things can go awfully wrong. <\/strong><\/p>\n\n\n\n\n\n\n\n

Imagine you are in a foreign country where you don\u2019t speak the language and your small child unexpectedly starts to have a fever seizure. You take them to the hospital, and the doctors use an online translator to let you know that your kid is going to be OK. But \u201cyour child is having a seizure\u201d accidentally comes up in your mother tongue is \u201cyour child is dead.\u201d<\/p>\n\n\n\n

This specific example is a very real possibility, according to a 2014 study published in the British Medical Journal about the limited usefulness of AI-powered machine translation in communications between patients and doctors. (Because it\u2019s a British publication, the actual hypothetical quote was \u201cyour child is fitting.\u201d Sometimes we need American-British translation, too.)<\/p>\n\n\n\n

Machine translation tools like Google Translate can be super handy, and Big Tech often promotes them as accurate and accessible tools that\u2019ll break down many intra-linguistic barriers in the modern world. But the truth is that things can go awfully wrong. Misplaced trust in these MT tools\u2019 ability is already leading to their misuse by authorities in high-stake situations, according to experts\u2014ordering a coffee in a foreign country or translating lyrics can only do so much harm, but think about emergency situations involving firefighters, police, border patrol, or immigration. And without proper regulation and clear guidelines, it could get worse.<\/p>\n\n\n\n

Machine translation systems such as Google Translate, Microsoft Translator, and those embedded in platforms like Skype and Twitter are some of the most challenging tasks in data processing. Training a big model can produce as much CO2 as a trans-Atlantic flight. For the  training, an algorithm or a combination of algorithms is fed a specific dataset of translations. The algorithms save words and their relative positions as probabilities that they may occur together, creating a statistical estimate as to what other translations of similar sentences might be. The algorithmic system, therefore, doesn\u2019t interpret the meaning, context, and intention of words, like a human translator would. It takes an educated guess\u2014one that isn\u2019t necessarily accurate.<\/p>\n\n\n\n

In South Korea, a young man used a Chinese-to-Korean translation app to tell his female co-worker\u2019s Korean husband they should all hang out together again soon. A mistranslation resulted in him erroneously referring to the woman as a nightlife establishment worker, resulting in a violent fistfight between the two in which the husband was killed, the Korea Herald reported in May. In Israel, a young man captioned a photo of himself leaning on a bulldozer with the Arabic caption \u201c\u064a\u0635\u0628\u062d\u0647\u0645,\u201d or \u201cgood morning,\u201d but the social media\u2019s AI translation rendered it as \u201churt them\u201d in English or \u201cattack them\u201d in Hebrew. This led the man, a construction worker, to being arrested and questioned by police, according to the Guardian in October 2017. Something similar happened in Denmark, where, the Copenhagen Post Online reported in September 2012, police erroneously confronted a Kurdish man for financing terrorism because of a mistranslated text message. In 2017, a cop in Kansas used Google Translate to ask a Spanish-speaker if they could search their car for drugs. But the translation was inaccurate and the driver did not fully understand what he had agreed to given the lack of accuracy in the translation. The case was thrown out of court, according to state legal documents.<\/p>\n\n\n\n

These examples are no surprise. Accuracy of translation can vary widely within a single language\u2014according to language complexity factors such as syntax, sentence length, or the technical domain\u2014as well as between languages and language pairs, depending on how well the models have been developed and trained. A\u00a02019 study showed that, in medical settings, hospital discharge instructions translated with Google Translate into Spanish and Chinese are getting better over the years, with between 81 percent and 92 percent overall accuracy. But the study also found that up to 8 percent of mistranslations actually have potential for significant harm. A\u00a0pragmatic assessment of Google Translate for emergency department instructions\u00a0from 2021 showed that the overall meaning was retained for 82.5 percent of 400 translations using Spanish, Armenian, Chinese, Tagalog, Korean, and Farsi. But while translations in Spanish and Tagalog are accurate more than 90 percent of the time, there\u2019s a 45 percent chance that they\u2019ll be wrong when it comes to languages like Armenian. Not all errors in machine translation are of the same severity, but quality evaluations always find some critical accuracy errors, according to\u00a0this June paper.<\/p>\n\n\n\n

The good news is that Big Tech companies are fully aware of this, and their algorithms are constantly improving. Year after year, their BLEU scores\u2014which measure how similar machine-translated text is to a bunch of high quality human translations\u2014get consistently better. Just recently, Microsoft replaced some of its translation systems with a more efficient class of AI model. Software programs are also updated to include more languages, even those often described as \u201clow-resource languages\u201d because they are less common or harder to work with; that includes most non-European languages, even widely used ones like Chinese, Japanese, and Arabic, to small community languages, like Sardinian and Pitkern. For example, Google has been building a practical machine translation system for more than 1,000 languages. Meta has just released the No Language Left Behind project, which attempts to deploy high-quality translations directly between 200 languages, including languages like Asturian, Luganda, and Urdu, accompanied by data about how improved the translations were overall.<\/p>\n\n\n\n

However, the errors that lead to consequential mistakes\u2014like the construction worker experienced\u2014tend to be random, subjective, and different for each platform and each language. So cataloging them is only superfluously helpful in figuring out how to improve MT, says F\u00e9lix Do Carmo, a senior lecturer at the Centre for Translation Studies at the University of Surrey. What we need to talk about instead, he says, is \u201cHow are these tools integrated into society?\u201d Most critically, we have to be realistic about what MT can and cannot do for people right now. This involves understanding the role machine translation can have in everyday life, when and where it can be used, and how it is perceived by the people using it. \u201cWe have seen discussions about errors in every generation of machine translation. There is always this expectation that it will get better,\u201d says Do Carmo. \u201cWe have to find human-scale solutions for human problems.\u201d<\/p>\n\n\n\n

And that means understanding the role human translators still need to play. Even as medications have gotten massively better over the decades, there still is a need for a doctor to prescribe them. Similarly, in many translation use cases, there is no need to totally cut out the human mediator, says Sabine Braun, director of the Centre for Translation Studies at the University of Surrey. One way to take advantage of increasingly sophisticated technology while guarding against errors is something called machine translation followed by post-editing, or MT+PE, in which a human reviews and refines the translation.<\/p>\n\n\n\n

One of the oldest examples of a company using MT+PE successfully is detailed in this 2012 study about Autodesk, a software company that provides imaging services for architects and engineers, which used post-editing for machine translation to translate the user interface into 12 languages. Other similar solutions have been reported by a branch of the consulting company EY, for example, and the Swiss bank MigrosBank, which found that post-editing boosted translation productivity by up to 60 percent, according to Slator. Already, some machine translation companies have stopped selling their technologies for direct use of clients and now always require some sort of post-editing translation, Do Carmo says. For example, Unbabel and Kantan are platform plugins that businesses add into their customer support and marketing workflows to reach clients all over the world. When they detect poor quality in the translated texts, the texts are automatically routed to professional editors. Although these systems aren\u2019t perfect, learning from these could be a start.<\/p>\n\n\n\n

Ultimately, Braun and Do Carmo think that it\u2019s necessary to develop holistic frameworks that go far beyond the metrics used at the moment to assess or evaluate quality of translation, like BLEU. They  would like to see the field working on an evaluation system which encompasses the \u201cwhy\u201d behind the use of translation, too. One approach might be an independent, international regulatory body to oversee the use and development of MT into the real world\u2014with plenty of social scientists on board. Already, there are many standards in the translation industry as well as technological standardization bodies, like the W3 organization\u2014so experts believe it can be done, as long as there is some more organization in the industry.<\/p>\n\n\n\n

Governments and private companies alike also need clear policies about exactly when<\/em> officials should and should not use machine translation tools, either free consumer ones or others. Neil Coulson is the founder of CommSOFT, a communication and language software technology company trying to make machine translation safer. \u201cPolice forces, border-control agencies, and many other official organizations aren\u2019t being told that machine translation isn\u2019t real translation and so they give these consumer gadgets a go,\u201d he says. In March 2020, his organization sent out a Freedom of Information request to 68 different large U.K. public-sector organizations asking for their policies on the use of consumer gadget translation technologies. The result: None of these organizations had any policy for their use of MT, and they do not monitor any of their organizational or staff\u2019s ad-hoc use of MT. This can lead to an unregulated, free-for-all landscape in which  anyone can publish a translation app and claim that it works, says Coulson. \u201cIt\u2019s a \u2018let a thousand flowers bloom\u2019 approach \u2026 but eventually someone eats a flower that turns out to be poisonous and dies,\u201d says Coulson.<\/p>\n\n\n\n

Education about the pros and cons of MT, of course, is paramount\u2014among researchers, companies, and organizations who want to actually start using the tool, but most importantly, among everyday users. That\u2019s why Lynne Bowker, a professor of translation and interpretation at the University of Ottawa, started the Machine Translation Literacy project. Their goal is to spread awareness of how MT systems process information and teach researchers and scholars how to actually use MT more effectively. Including information about machine translation as part of the broader digital literacy and information literacy training given to school kids would also be welcome. \u201cBeing machine translation literate means understanding the essentials of how this technology works in order to be able to evaluate its strengths and weaknesses for a particular task or use,\u201d says Bowker. Language, in a social context, is communication. \u201cOne of the real challenges we are facing is how to reach the wider public with this message,\u201d says Bowker.<\/p>\n\n\n\n

Being able to differentiate between low-stakes tasks and high-stakes tasks remains one of the key points, Bowker says. Thankfully, in the meantime, most mistranslations still just lead up to a laugh: According to a 2016 study in International Journal of Communication, there\u2019s a Chinese restaurant called Translate Server Error. The MT system mistranslated the original language, but the restaurant owners didn\u2019t know English well enough to realize something was off.<\/p>\n\n\n\n

This article was first published at Slate<\/a>, on September 21, 2022.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"

Machine translation tools like Google Translate can be super handy. But the truth is that things can go awfully wrong.<\/p>\n","protected":false},"author":19,"featured_media":8893,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[127],"tags":[366,387,297],"class_list":["post-8892","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-curiosidades","tag-english","tag-technology","tag-translation"],"acf":[],"_links":{"self":[{"href":"https:\/\/globaltranslations.com.br\/en\/wp-json\/wp\/v2\/posts\/8892","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/globaltranslations.com.br\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/globaltranslations.com.br\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/globaltranslations.com.br\/en\/wp-json\/wp\/v2\/users\/19"}],"replies":[{"embeddable":true,"href":"https:\/\/globaltranslations.com.br\/en\/wp-json\/wp\/v2\/comments?post=8892"}],"version-history":[{"count":2,"href":"https:\/\/globaltranslations.com.br\/en\/wp-json\/wp\/v2\/posts\/8892\/revisions"}],"predecessor-version":[{"id":8916,"href":"https:\/\/globaltranslations.com.br\/en\/wp-json\/wp\/v2\/posts\/8892\/revisions\/8916"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/globaltranslations.com.br\/en\/wp-json\/wp\/v2\/media\/8893"}],"wp:attachment":[{"href":"https:\/\/globaltranslations.com.br\/en\/wp-json\/wp\/v2\/media?parent=8892"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/globaltranslations.com.br\/en\/wp-json\/wp\/v2\/categories?post=8892"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/globaltranslations.com.br\/en\/wp-json\/wp\/v2\/tags?post=8892"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}