"Comic Translate." "Many Automatic Manga Translators exist. Very few properly support comics of other kinds in other languages. This project was created to utilize the ability of GPT-4 and translate comics from all over the world. Currently, it supports translating to and from English, Korean, Japanese, French, Simplified Chinese, Traditional Chinese, Russian, German, Dutch, Spanish and Italian."

For a couple dozen languages, the best Machine Translator is not Google Translate, Papago or even DeepL, but GPT-4, and by far. This is very apparent for distant language pairs (Korean<->English, Japanese<->English etc) where other translators still often devolve into gibberish.

Works by combining neural networks for speech bubble detection, text segmentation, OCR, inpainting, translation, and text rendering. The neural networks for speech bubble detection, text segmentation, and inpainting apply to all languages, while OCR, translation, and text rendering are language-specific.

Comic Translate

#solidstatelife #ai #computervision #mt #genai #gpt #manga #anime