Multilingual OCR Development Plan

[D-DanielYang]

model name	description	model size	download	Update Date
ch	Chinese and English	3.71M	inference model / trained model	2020.9.22
ch_tra	chinese traditional	5.63M	inference model / trained model	2021.1.21
en	English	2.56M	inference model / trained model	2020.9.22
fr	French	2.65M	inference model / trained model	2021.9.22
ar	Arabic	2.53M	inference model / trained model	2021.1.21
es	Spanish	2.53M	inference model / trained model	2021.1.21
pt	Portuguese	2.63M	inference model / trained model	2021.1.21
ru	Russia	2.63M	inference model / trained model	2021.1.21
ge	german	2.65M	inference model / trained model	2020.9.22
kr	Korean	3.9M	inference model / trained model	2020.9.22
jp	Japanese	4.23M	inference model / trained model	2020.9.22
it	Italian	2.53M	inference model / trained model	2021.1.21
hi	Hindi	2.63M	inference model / trained model	2021.1.21
ug	Uyghur	2.63M	inference model / trained model	2021.1.21
fa	Persian	2.63M	inference model / trained model	2021.1.21
ur	Urdu	2.63M	inference model / trained model	2021.1.21
oc	Occitan	2.53M	inference model / trained model	2021.1.21
mr	Marathi	2.63M	inference model / trained model	2021.1.21
ne	Nepali	2.63M	inference model / trained model	2021.1.21
rs_cyrillic	Serbian(cyrillic)	2.63M	inference model / trained model	2021.1.21
rs_latin	Serbian(latin)	2.53M	inference model / trained model	2021.1.21
bg	Bulgarian	2.63M	inference model / trained model	2021.1.21
uk	Ukranian	2.63M	inference model / trained model	2021.1.21
be	Belarusian	2.63M	inference model / trained model	2021.1.21
te	Telugu	2.63M	inference model / trained model	2021.1.21
kn	Kannada	2.63M	inference model / trained model	2021.1.21
ta	Tamil	2.63M	inference model / trained model	2021.1.21
mg	Mongolian	--	Ongoing
bn	Bangla	--	#13373	call for contribution
bm	Burmese	--	Need dict and corpus	call for contribution
ku_cent	kurdish central	--	PR8347	call for contribution
od	Odia	--	PR6348	call for contribution
th	thai	--	PR6719 issue chat	call for contribution
	More		TBC

Guideline for new language requests

If you want to request a new language support, a PR with 2 following files are needed：

1. In folder ppocr/utils/dict,
   it is necessary to submit the dict text to this path and name it with {language}_dict.txt that contains a list of all characters. Please see the format example from other files in that folder.

2. In folder ppocr/utils/corpus,
   it is necessary to submit the corpus to this path and name it with {language}_corpus.txt that contains a list of words in your language.
   Maybe, 50000 words per language is necessary at least.
   Of course, the more, the better.

3. call for contributions to add new language support for PaddleOCR.
   For anyone might be insterested in traing the new language model, Guidance to train the model is provided. We are calling contributions to add new language support for PaddleOCR.

If your language has unique elements, please tell me in advance within any way, such as useful links, wikipedia and so on.

[saheya]

Traditional Mongolian

[omar16100]

I would love to work on "Bangla"

[levanpon98]

I very happy if you do that with Vietnamese

[HusseinYoussef]

How about Arabic? That would be great.

[Hieung28]

I've find out that PADDLE OCR algorithm cannot recognize some special characters (such as comma, semicolon, or dot...) when the language is english. Is there any possible way that i can fix this problem

[GmGniap]

I would like to contribute to add the Burmese language. Is it only needed to submit two text files - dict & corpus? How further process do we need to provide?

[xeron56]

Adding "Bangla" will be grate for the people in south Asia

[giranntu]

Adding "Traditional Chinese (zh-TW)" would be great support.

[Ru-Van]

Do you have preTrained Russian recognition model?

[SasiAravind]

Hi adding " Tamil" language will be very grateful.

Tamil_dict.txt
Tamil_corpus.txt

Need more help plz refer this issue:
JaidedAI/EasyOCR#39

[krzynio]

I can help with polish language.

[xmy0916]

@GmGniap Hello, Can you provide the corpus file of Burmese Language？

[xmy0916]

@shahidul56 Hello, Can you provide the corpus file of Bangla Languag？

[azmat21]

All models updated in 2021.1.21 cannot be downloaded with following Error：
{ code: "NoSuchKey", message: "The specified key does not exist.", requestId: "aa1bfeff-f572-40aa-8935-6129b1533ed1" }

[D-DanielYang]

All models updated in 2021.1.21 cannot be downloaded with following Error：
{ code: "NoSuchKey", message: "The specified key does not exist.", requestId: "aa1bfeff-f572-40aa-8935-6129b1533ed1" }

Sorry for the invalid links and all of them have been revised now, you can try again.

[zahamed]

Hi Dear plz add the bangla and english support. I have attach both the file for bangla
bangla_dict.txt

bangla_corpus.txt

[EdwardYGLi]

Hi team. Great work on Paddle, it's an amazing OCR engine! Can we please have Hebrew support in multilanguage models ?

Thanks !

[zahamed]

Dear Team, Tnx for your reply. I am from Bangladesh. I have already submitted both files like dict and corpus for bangla. I would appreciate if you could add bangla support. Thank you. Zahir

…

On Fri, Jul 28, 2023, 1:50 AM Edward Li ***@***.***> wrote: Hi team. Great work on Paddle, it's an amazing OCR engine! Can we please have *Hebrew* support in multilanguage models ? Thanks ! — Reply to this email directly, view it on GitHub <#1048 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AD6CAOC6MTVJDVXY4W65TWDXSLBCHANCNFSM4TCPRJ6Q> . You are receiving this because you commented.Message ID: ***@***.***>

[shreyaahh]

Can you provide for any ancient scripts?

[hungtrieu07]

Truong

I'm trying with my private data, but the result very poor

[SUPERustam]

Sorry for my stupid question, I am novice at DL: What difference between Inference model and trained model?

[taeefnajib]

I created a PR for Bangla

[juvebogdan]

Does this list contain the latest models? If i want to fine tune for example german model do i use this link from this page to download the pretrained model? If so what yml file should i use? How do i know what is the architecture of these models?

[AzizDZH]

Please add Tajik Language
tajik_corpus.txt
tajik_dict.txt

[Sardar14]

I want to work on Kurdish Center language

[taeefnajib]

I sent a PR for Bangla support #13373
btw do you not have the corpus folder anymore?

[umitoguz]

pls add Turkish languange.Thank you.

[lingskr]

I have a copy on my GitHub at "ppocr/utils/dict" and I need to commit the dictionary text to this path and name it "vi_dict.txt" which contains a list of all characters. Vietnamese dictionary from Wikipedia.

I did not find the corpus in the folder "ppocr/utils/corpus"; I could only view it in my GitHub. Link here.

[hungtrieu07]

Thank you.

[umitoguz]

I didnot ask for vie.I asked for Turkish Languange. 19 Ağu 2024 Pzt 10:57 tarihinde Songling Huang ***@***.***> şunu yazdı:

…

I have a copy on my GitHub at "ppocr/utils/dict" and I need to commit the dictionary text to this path and name it "vi_dict.txt" which contains a list of all characters. Vietnamese dictionary from Wikipedia. I did not find the corpus in the folder "ppocr/utils/corpus"; I could only view it in my GitHub. Link here <https://github.com/lingskr/Vietnamese-Corpus-and-Dictionary>. — Reply to this email directly, view it on GitHub <#12734 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ANG56EVPGOQ5BHPXFRMWRV3ZSGQNRAVCNFSM6AAAAABKZTCY7CVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAMZYGAYDINA> . You are receiving this because you commented.Message ID: ***@***.*** com>

[lingskr]

I know there is no requirement. Does PaddleOCR multi-language OCR plan to add Vietnamese in the future? Is there no future plan for this? Can it not be added in the future?

[hungtrieu07]

@lingskr Maybe you can train Vietnamese model by yourself

[lingskr]

@hungtrieu07 Yes, I have trained my model. My internship content is to improve the performance of the large model, and I am responsible for OCR, which is Burmese, Vietnamese and other small languages ​​in Southeast Asian countries. What I want to do is to use PaddleOCR to improve the performance of LLM

The purpose of my contribution is also to hope that everyone can try it. After all, I encountered difficulties during the internship. For example, Burmese is a typical character combination language. There are multiple characters embedded in a receptive field. The existing Burmese recognition method mainly recognizes from the character granularity. When decoding, some characters are not correctly recognized and cause local garbled characters.

Contribute it, everyone will improve it further. I hope that in the future, PaddleOCR can achieve the same effect as Chinese and English in the face of different texts. Personally, I think PaddleOCR is already the strongest among the open source OCRs. This is also the multi-language plan of PaddleOCR.

[gun-hash]

How do i use these models?