IBM-MODEL-1

Machine translation assignment by Dr.Kamlesh Dutta @ NIT hamirpur

There are 3 .ipynb files

Jupyter notebook is used.

Word probabilty files shows probability of word occurence.

IBM model files shows how to implement IBM model from scratch and also NLTK being used for alignment purpose only.

Another is uploaded to show Perplexity graph behaviour with examples being taken from "Statistical Machine Translation" by Philipp Koehn

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
IBM model 1 Perplexity by Sahoo.ipynb		IBM model 1 Perplexity by Sahoo.ipynb
IBM model 1 Perplexity by Sahoo.pdf		IBM model 1 Perplexity by Sahoo.pdf
IBM model 1 SUBRAMANYAM SAHOO.ipynb		IBM model 1 SUBRAMANYAM SAHOO.ipynb
IBM model 1 SUBRAMANYAM SAHOO.pdf		IBM model 1 SUBRAMANYAM SAHOO.pdf
README.md		README.md
Word Probability by SAHOO.ipynb		Word Probability by SAHOO.ipynb
dev.en.txt		dev.en.txt
dev.hi		dev.hi
dev_translations.txt		dev_translations.txt
dev_version1.txt		dev_version1.txt
dev_version2.txt		dev_version2.txt
english originale.txt		english originale.txt
english test.txt		english test.txt
hindi originale.txt		hindi originale.txt
hindi test.txt		hindi test.txt
test.en		test.en
test.hi		test.hi
train.en		train.en
train.hi		train.hi

Provide feedback