Skip to content

This repository contains the source code of the models submitted by MIDAS team in SemEval 2019 Task 9 - SubTask. Our team was ranked 10th in the Task with F1 score 0.7011

Notifications You must be signed in to change notification settings

sarthusarth/SemEval9_MIDAS

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

========================

SemEval 2019 Task 9 - SubTask A - Suggestion Mining from Online Reviews and Forums

https://competitions.codalab.org/competitions/19955

========================

1) DESCRIPTION

This repository contains the source code of the models submitted by MIDAS team in SemEval 2019 Task 9 - SubTask. It was ranked 10th in the Task with F1 score 0.7011

2) TASKS AND LABELS

(A) Sub-task A:

Under this subtask, participants will perform domain specific suggestion mining, where the test dataset will belong to the same domain as the training and development datasets, i.e. suggestion forum for windows platform developers.

(B) Sub-task B: Automatic categorization of offense types

Under this subtask, participants will perform cross domain suggestion mining, where train/development and test datasets will belong to separate domains. Train and development datasets will remain the same as subtask A, while the test dataset will belong to the domain of hotel reviews

3) Evaluation Metrics

Classification performance of the submissions will be evaluated on the basis of F-1 score for the positive class, i.e. the suggestion class. F1 score will range from 1 to 0.

4) CREDITS

Task Organizers

  • Sapna Negi (Genesys Telecommunications Laboratory Inc, Galway, Ireland)
  • Tobias Daudert (Insight Centre for Data Analytics, National University of Ireland Galway, Galway, Ireland)
  • Paul Buitelaar ( Insight Centre for Data Analytics, National University of Ireland Galway, Galway, Ireland)
  • Saeedeh Shekarpour (Computer Science Department, University of Dayton, Dayton, Ohio, USA )

5) Contact

https://groups.google.com/forum/#!forum/semeval-2019-task-9

About

This repository contains the source code of the models submitted by MIDAS team in SemEval 2019 Task 9 - SubTask. Our team was ranked 10th in the Task with F1 score 0.7011

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages