Skip to content

Reproducing traditional run on the MS MARCO leaderboard

Compare
Choose a tag to compare
@searchivarius searchivarius released this 14 Dec 02:50
· 920 commits to master since this release
713e416

This short documents describes a traditional IR system that achieved MRR@100 equal to 0.298 on the MS MARCO leaderboard (on 2020-12-06). Although inferior to most BERT-based models, it outperformed five neural submissions,
including two submissions that used a large pretrained Transformer model for re-ranking. We provide software and data to reproduce our results.