Skip to content

OSIRRC 2019 Release

Latest
Compare
Choose a tag to compare
@ryan-clancy ryan-clancy released this 28 Jun 17:58
· 3 commits to master since this release
7f6efa3
Merge azure-script into master (#113)

* Update Azure script

* and make sure it's uncommented...

* Enable timings for terrier and pisa

* Capture logs and scp back to local.

* Update robust04 runbook

* Remove P@5 from OldDog config

* robust04, core17, and core18 runbooks.

* Update terrier version in runbook

* Update core17 runbook

* Update terrier runbook

* Whoops...

* Update olddog version

* Add anserini-bm25prf to runbook

* Update anserini-bm25prf

* Update anserini-bm25prf

* Update robust05 path for irc-centre2019

* Add ielab and galago to runbook

* Write an additional file with the trec_eval results

* Update runbook for official releases

* Add NDCG@20 by default and fix anserini-bm25prf output directory

* Don't create .trec_eval files for non-trec files

* Merge master into azure-script (#111)

* Add files via upload (#104)

* Evaluate on all topics instead of those with documents retrieved (#108)

* Added TREC7 and TREC8 qrels (primarily to avoid confusion with the WT qrels in `qrels/qrels.401-450.txt`

* Missing TREC7 topics files

* Change default to setting also used in the "official" evaluation

* Add -c flag for trec_eval

* Revert "Change default to setting also used in the "official" evaluation"

This reverts commit 85b13dfc48d98593aa1530b97b6b5493ceecfd07.

* TREC Terabyte 04-06 topic/qrel files merged (#109)