Manga Translator

Python tool for translating text found within speech bubbles in manga images. It utilizes YOLOv8 for bubble detection, MangaOCR for text extraction, OpenCV, NumPy and Pillow for image processing and translation services like google, bing, baidu and Helsinki-NLP's opus-mt-ja-en model for text translation.

► For more informations check the github repository here.

► The project can be seen on HuggingFace.

How it works

• Detect speech bubbles in manga images.
• Extract text from detected speech bubbles.
• Clear speech bubbles for better visualization.
• Translate extracted text to the desired language.
• Add translated text back into the speech bubbles.

Getting started

Clone the repository

git clone https://github.com/georgescutelnicu/Manga-Translator.git

Install the required dependencies

pip install -r requirements.txt

Command Line Interface

Navigate to the directory where you cloned the repository

cd Manga-Translator

Run the main.py script with the required arguments

python main.py --model-path /path/to/model --image-path /path/to/image --font-path /path/to/font --translator [google/hf] --save-path /path/to/save

Flask Web App

Navigate to the directory where you cloned the repository

cd Manga-Translator

Run the Flask app

python app.py

Open your web browser and go to http://localhost:5000 to access the app.