Skip to content
/ SOME Public

SOME: Reference-less Sub-Metrics Optimized for Manual Evaluations of Grammatical Error Correction

Notifications You must be signed in to change notification settings

kokeman/SOME

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 

Repository files navigation

SOME

SOME: Reference-less Sub-Metrics Optimized for Manual Evaluations of Grammatical Error Correction
Paper: https://www.aclweb.org/anthology/2020.coling-main.573.pdf

Dependencies

  • Python >= 3.6.0
  • Pytorch >= 1.3.1
  • transformers >= 3.0.2

Trained models and Dataset

How to use

python some.py [hypothesis file] [source file] \
    --g-dir [directry path of grammar model] \
    --f-dir [directry path of fluency model] \
    --m-dir [directry path of meaning model] > predict_score

More option can be found python some.py -h.
The default weight of each model are tuned with Kendall tau on Grundkiewicz et al. (2015). Details can be found the paper.

About

SOME: Reference-less Sub-Metrics Optimized for Manual Evaluations of Grammatical Error Correction

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages