- Download GeoQA+ benchmark [Google Drive]
- Download the GeoQA.rar(If it need permission please apply it through the Google drive link or contact this e-mail address to get it: jiecao@m.scnu.edu.cn, You can also contact this email address for any other issues), move it to GeoQA+/data/GeoQA2.2 path, and unzip it. GeoQA-train.pk is the training set of GeoQA, Mix-train.pk are the training set after mixing our newly annotated problems with GeoQA-train.pk,Backtrans-train.pk is the training set after performing data augmentation on Mix-train, new-test.pk is the test set formed by our new dataset. When using data files as training sets make sure to rename the corresponding data files to "train.pk".
- Repalce the vocabulary file of Pre-training model with our "vocab.txt".
pip install -r requirement.txt
cd GeoQA+
unzip and rename the dataset
run: allennlp train config/NGS_Aux.json --include-package NGS_Aux -s save/test
run: allennlp evaluate save/test data/GeoQA2.2/test.pk --include-package NGS_Aux_test --cuda-device 0