Can GPT-4 translate literature?

Channel:Tom Gally · Length:19:37 · Published:2023-03-18 · Views:5959

Watch on YouTube

Summary

Tom Gally, a former professional translator and University of Tokyo professor, discusses in March 2023 whether GPT-4 and similar models could translate literary and popular fiction. He gives his assessment of Japanese-to-English quality.

Why HN recommends it

Cited as an expert's first-hand evidence that GPT translation is near human quality for distant language pairs.

the basic quality of the translation [from Japanese to English] is as good as a human might do — HN, 2023

LLMs & generative AI · Computer vision, speech & NLP · Language & linguistics

Subtitles (excerpt)

about six weeks ago I made a video about using chat GPT for translation and I showed how in the case of translation from Japanese to English at least uh chat GPT was a better translator than Google translate or debail the reason why was it is able to maintain the cohesion of the text so it seems to know what the text is about to some extent and for example if a certain person is being referred to it will use consistent pronouns about that person through the text well Google translate and detail at this point seem to be translating sentence by sentence and so in the case of Japanese Japanese to English translation where the pronouns the subjects might not be explicitly indicated in the sentence it screws up it once now this person is he now it's a she now it's the day now it's I and so a few days ago open AI released a successor to chat G PT which is called gpt4 and so I immediately started trying translation on it and it's so much better um if you've been following the news about jet gpt4 it's better about a lot of other tests as well too for example writing computer programs and when asked to write essays and things like this it can be much more sort of creative and and things like that so it's it's it's a it's a surprising shocking

On Hacker News

As I explained in a sister comment, it is not possible to rate translation quality objectively, as opinions and positions about what constitutes a good translation vary. But in my tests of reasoning models since the release of o1-preview, they have not seemed as reliable as the straight nonreasoning versions of ChatGPT, Claude, or Gemini. The translation process itself usually doesn’t seem to req… — tkgally, 2025-02
>about machine translation and looked at some results of translating between English and French. It was difficult to find any fault with the translation. This has never been the case for distant language pairs till GPT. That is a pretty big change. [VIDEO] — og_kalu, 2023-09
>but nobody in the very well funded translation industry has a GPT powered translation engine for the key reason that it's not ready for production. Translator for 20 years talking about using GPT for Japanese-English. [VIDEO] [LINK] — og_kalu, 2023-09
Are you giving it multiple paragraphs to translate at once so that it has enough context for a good translation? If so, would you mind sharing a sample input and output that you found unsatisfactory? In "Can GPT-4 translate literature?" (Mar 18, 2023) [ [VIDEO] ], Tom Gally, a former professional translator and current professor at the University of Tokyo, said: > …the point is, to my eye at leas… — bumbledraven, 2023-03

Related videos