GitHub - microsoft/MSMARCO-Passage-Ranking: MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, and passage ranking. A variant of this task will be the part of TREC and AFIRM 2019. For Updates about TREC 2019 please follow This Repository Passage Reranking task Task Given a query q and a the 1000 most relevant passages P = p1, p2, p3,... p1000, as retrieved by BM25 a succeful system is expected to rerank the most relevant passage as high as possible. For this task not all 1000 relevant items have a human labeled relevant passage. Evaluation will be done using MRR

microsoft / MSMARCO-Passage-Ranking Public

Notifications You must be signed in to change notification settings
Fork 38
Star 305

MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, and passage ranking. A variant of this task will be the part of TREC and AFIRM 2019. For Updates about TREC 2019 please follow This Repository Passage Reranking task Task Given a query q and a the 1000 most rel…

microsoft.github.io/msmarco-passage-ranking/

MIT license

305 stars 38 forks Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 31 Commits
Baselines		Baselines
Leaderboard Results		Leaderboard Results
.gitignore		.gitignore
DL Track Overview TREC2019.pptx		DL Track Overview TREC2019.pptx
GenerateData.script		GenerateData.script
LICENSE		LICENSE
README.md		README.md
SECURITY.md		SECURITY.md
_config.yml		_config.yml
generateBERTPassageEmbedding.py		generateBERTPassageEmbedding.py
generate_qrel.py		generate_qrel.py
get_all_passages.py		get_all_passages.py
getstats.py		getstats.py
makeidf.py		makeidf.py
makeqidpid.py		makeqidpid.py
ms_marco_eval.py		ms_marco_eval.py
run.sh		run.sh
selected2document.py		selected2document.py
stats.txt		stats.txt
subsample.py		subsample.py