ishiwatari-naacl2019

• Paper: Learning to Describe Unknown Phrases with Local and Global Contexts
• Authors: Shonosuke Ishiwatari, Hiroaki Hayashi, Naoki Yoshinaga, Graham Neubig, Shoetsu Sato, Masashi Toyoda, and Masaru Kitsuregawa

Requirements

• Pytorch (1.0.0)
• torchtext (0.2.3)
• torchvision (0.1.9)
• numpy (1.15.4)
• nltk (3.2.5)

Download Dataset

wget http://www.tkl.iis.u-tokyo.ac.jp/~ishiwatari/naacl_data.zip
unzip naacl_data.zip

Run Experiments

cd exp
./run_oxford.sh  # Run expreiments on Oxford Dictionary [Gadetsky+ 2018]
./run_slang.sh   # Run experiments on Urban Dictionay [Ni & Wang 2017]
./run_wiki.sh    # Run experiments on Wikipedia Dataset [Ishiwatari+ 2019]
./run_wordnet.sh # Run experiments on Wordnet [Noraset+ 2017]

Reproduce BLEU Scores in the paper

Wikidata Dataset

# After training
./test.sh

Wordnet, Urban Dictionay, and Oxford Dictionary Datasets

# After training
tail -3 train.log

Contact

Shonosuke Ishiwatari

ishiwatari (at) tkl.iis.u-tokyo.ac.jp