Evaluation of existing Poincaré embedding implementations

[janpom]

Implementations

• https://github.com/TatsuyaShirakawa/poincare-embedding
• https://github.com/nishnik/poincare_embeddings

Data sets

• WordNet
  • The version used for training/evaluation is prepared with this script from the c++ poincare embedding repository
• HyperLex
• scientific collaboration social networks
  • AstroPh
  • CondMat
  • GrQc
  • HepPh

Evaluation experiments

• WordNet reconstruction
• WordNet link prediction
• link prediction in social networks
• lexical entailment on HyperLex & WordNet (for training)

Deliverables

• Jupyter notebook
  • evaluation code
  • evaluation results
  • summary

Requirements

• runnable notebook with minimal necessary dependencies
• ideally, as part of the setup
  • datasets are downloaded
  • implementations are downloaded and installed
• notebook easy to read, concise (no long printouts)
• clean code (PEP8, DRY)

[janpom]

done in #1643