diff --git a/README.md b/README.md index 20d77924bb..f8ceb50fe1 100644 --- a/README.md +++ b/README.md @@ -255,7 +255,7 @@ See individual pages for details! + Regressions for Complex Answer Retrieval (CAR17): [v1.5](docs/regressions-car17v1.5.md), [v2.0](docs/regressions-car17v2.0.md), [v2.0 with doc2query](docs/regressions-car17v2.0-doc2query.md) + Regressions for TREC News Tracks (Background Linking Task): [2018](docs/regressions-backgroundlinking18.md), [2019](docs/regressions-backgroundlinking19.md), [2020](docs/regressions-backgroundlinking20.md) + Regressions for [FEVER Fact Verification](docs/regressions-fever.md) -+ Regressions for DPR Wikipedia QA baselines: [100-word splits](docs/regressions-wikipedia-dpr-100w-bm25.md) ++ Regressions for DPR Wikipedia QA baselines: [100-word splits](docs/regressions-wikipedia-dpr-100w-bm25.md), [6/3 sliding window sentences](docs/regressions-wiki-all-6-3-tamber-bm25.md) diff --git a/docs/regressions-backgroundlinking18.md b/docs/regressions-backgroundlinking18.md index 8194d72db8..040ad4102b 100644 --- a/docs/regressions-backgroundlinking18.md +++ b/docs/regressions-backgroundlinking18.md @@ -1,4 +1,4 @@ -# Anserini Regressions: TREC 2018 News Track (Background Linking) +# Anserini Regressions: TREC 2018 News Background Linking **Models**: various bag-of-words approaches @@ -33,10 +33,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.backgroundlinking18.txt`](../tools/topics-and-qrels/topics.backgroundlinking18.txt): [topics for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/newsir18-topics.txt) -+ [`qrels.backgroundlinking18.txt`](../tools/topics-and-qrels/qrels.backgroundlinking18.txt): [qrels for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/bqrels.exp-gains.txt) ++ [`topics.backgroundlinking18.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking18.txt): [topics for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/newsir18-topics.txt) ++ [`qrels.backgroundlinking18.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.backgroundlinking18.txt): [qrels for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/bqrels.exp-gains.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-backgroundlinking19.md b/docs/regressions-backgroundlinking19.md index cdec4ad2b4..d59d7290e6 100644 --- a/docs/regressions-backgroundlinking19.md +++ b/docs/regressions-backgroundlinking19.md @@ -1,4 +1,4 @@ -# Anserini Regressions: TREC 2019 News Track (Background Linking) +# Anserini Regressions: TREC 2019 News Background Linking **Models**: various bag-of-words approaches @@ -33,10 +33,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.backgroundlinking19.txt`](../tools/topics-and-qrels/topics.backgroundlinking19.txt): topics for the background linking task of the TREC 2019 News Track -+ [`qrels.backgroundlinking19.txt`](../tools/topics-and-qrels/qrels.backgroundlinking19.txt): qrels for the background linking task of the TREC 2019 News Track ++ [`topics.backgroundlinking19.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking19.txt): topics for the background linking task of the TREC 2019 News Track ++ [`qrels.backgroundlinking19.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.backgroundlinking19.txt): qrels for the background linking task of the TREC 2019 News Track After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-backgroundlinking20.md b/docs/regressions-backgroundlinking20.md index e4c5bde3db..f90e61a398 100644 --- a/docs/regressions-backgroundlinking20.md +++ b/docs/regressions-backgroundlinking20.md @@ -1,4 +1,4 @@ -# Anserini Regressions: TREC 2020 News Track (Background Linking) +# Anserini Regressions: TREC 2020 News Background Linking **Models**: various bag-of-words approaches @@ -33,10 +33,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.backgroundlinking20.txt`](../tools/topics-and-qrels/topics.backgroundlinking20.txt): topics for the background linking task of the TREC 2020 News Track -+ [`qrels.backgroundlinking20.txt`](../tools/topics-and-qrels/qrels.backgroundlinking20.txt): qrels for the background linking task of the TREC 2020 News Track ++ [`topics.backgroundlinking20.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking20.txt): topics for the background linking task of the TREC 2020 News Track ++ [`qrels.backgroundlinking20.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.backgroundlinking20.txt): qrels for the background linking task of the TREC 2020 News Track After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-arguana-flat-wp.md b/docs/regressions-beir-v1.0.0-arguana-flat-wp.md index bd083627f0..b23bdd5877 100644 --- a/docs/regressions-beir-v1.0.0-arguana-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-arguana-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-arguana-flat.md b/docs/regressions-beir-v1.0.0-arguana-flat.md index 53d9efad8d..c523e71b5f 100644 --- a/docs/regressions-beir-v1.0.0-arguana-flat.md +++ b/docs/regressions-beir-v1.0.0-arguana-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-arguana-multifield.md b/docs/regressions-beir-v1.0.0-arguana-multifield.md index 06bb3da82b..b111acfed7 100644 --- a/docs/regressions-beir-v1.0.0-arguana-multifield.md +++ b/docs/regressions-beir-v1.0.0-arguana-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-arguana-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-arguana-splade-distil-cocodenser-medium.md index 6182990b7c..5ea241bd0c 100644 --- a/docs/regressions-beir-v1.0.0-arguana-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-arguana-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-arguana-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-arguana-unicoil-noexp.md index 55f8e933f1..814c947b24 100644 --- a/docs/regressions-beir-v1.0.0-arguana-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-arguana-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-bioasq-flat-wp.md b/docs/regressions-beir-v1.0.0-bioasq-flat-wp.md index 9ba2779e8d..4b0bfd4538 100644 --- a/docs/regressions-beir-v1.0.0-bioasq-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-bioasq-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-bioasq-flat.md b/docs/regressions-beir-v1.0.0-bioasq-flat.md index 90591f508e..e7a140d5ff 100644 --- a/docs/regressions-beir-v1.0.0-bioasq-flat.md +++ b/docs/regressions-beir-v1.0.0-bioasq-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-bioasq-multifield.md b/docs/regressions-beir-v1.0.0-bioasq-multifield.md index aea08b4b6e..d1cf5916d7 100644 --- a/docs/regressions-beir-v1.0.0-bioasq-multifield.md +++ b/docs/regressions-beir-v1.0.0-bioasq-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-bioasq-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-bioasq-splade-distil-cocodenser-medium.md index 08b5694240..d28fe8715d 100644 --- a/docs/regressions-beir-v1.0.0-bioasq-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-bioasq-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-bioasq-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-bioasq-unicoil-noexp.md index 1c86c19aaa..b59b3c1849 100644 --- a/docs/regressions-beir-v1.0.0-bioasq-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-bioasq-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-climate-fever-flat-wp.md b/docs/regressions-beir-v1.0.0-climate-fever-flat-wp.md index ae465dac9e..2a7c903f98 100644 --- a/docs/regressions-beir-v1.0.0-climate-fever-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-climate-fever-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-climate-fever-flat.md b/docs/regressions-beir-v1.0.0-climate-fever-flat.md index ff10a6e856..3414adebd5 100644 --- a/docs/regressions-beir-v1.0.0-climate-fever-flat.md +++ b/docs/regressions-beir-v1.0.0-climate-fever-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-climate-fever-multifield.md b/docs/regressions-beir-v1.0.0-climate-fever-multifield.md index 95020e8116..913a39511b 100644 --- a/docs/regressions-beir-v1.0.0-climate-fever-multifield.md +++ b/docs/regressions-beir-v1.0.0-climate-fever-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-climate-fever-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-climate-fever-splade-distil-cocodenser-medium.md index 4ee1797e23..d8df368013 100644 --- a/docs/regressions-beir-v1.0.0-climate-fever-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-climate-fever-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-climate-fever-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-climate-fever-unicoil-noexp.md index 525c238c1e..159edd91d0 100644 --- a/docs/regressions-beir-v1.0.0-climate-fever-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-climate-fever-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-android-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-android-flat-wp.md index e96c193b2d..fe8288c277 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-android-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-android-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-android-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-android-flat.md index 64dd36e042..3b3d751bb7 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-android-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-android-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-android-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-android-multifield.md index e04689cae1..e09e5104c1 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-android-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-android-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-android-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-android-splade-distil-cocodenser-medium.md index 9730a3dbc0..362756bf0c 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-android-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-android-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-android-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-android-unicoil-noexp.md index e92ba62ea5..2391e22348 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-android-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-android-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-english-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-english-flat-wp.md index fa2a8a1ae0..846774acbf 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-english-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-english-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-english-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-english-flat.md index e09b1f78a4..c1b8acce11 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-english-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-english-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-english-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-english-multifield.md index 9b28e7f859..9d332b3125 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-english-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-english-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-english-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-english-splade-distil-cocodenser-medium.md index 0115272bc0..522062ff8d 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-english-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-english-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-english-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-english-unicoil-noexp.md index e1063fe2f5..146282e6f3 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-english-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-english-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat-wp.md index fec75dc8c0..e3eff9ebe4 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat.md index 65fd8b8127..ecbe2d72cb 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-gaming-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-gaming-multifield.md index 1ff01615cc..7aaad9bb2e 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-gaming-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-gaming-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-gaming-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-gaming-splade-distil-cocodenser-medium.md index 370d2ece32..eba6276f09 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-gaming-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-gaming-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-gaming-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-gaming-unicoil-noexp.md index 59c09b15d0..89c584ecb5 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-gaming-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-gaming-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-gis-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-gis-flat-wp.md index e325ca7a10..c22ee68b26 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-gis-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-gis-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-gis-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-gis-flat.md index 25bc66eaf5..999c2063c9 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-gis-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-gis-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-gis-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-gis-multifield.md index fb35833cf9..6ab3769e0c 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-gis-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-gis-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-gis-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-gis-splade-distil-cocodenser-medium.md index 7389abaf76..90d9816d3b 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-gis-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-gis-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-gis-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-gis-unicoil-noexp.md index f104f81798..febfd0a7eb 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-gis-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-gis-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat-wp.md index 9970eaf0a3..3bafebcfb5 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat.md index d3c52b574d..50f12baf99 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-multifield.md index 7cd111f15c..3a4b0a4410 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-splade-distil-cocodenser-medium.md index e681702ed3..61a20c5e38 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-unicoil-noexp.md index 2d2066f5d9..f8e6ad94f6 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-mathematica-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-physics-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-physics-flat-wp.md index 66630a5d9a..939ff10392 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-physics-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-physics-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-physics-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-physics-flat.md index a7f577edf8..e08f9cadb9 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-physics-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-physics-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-physics-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-physics-multifield.md index cb62948dce..b23d619607 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-physics-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-physics-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-physics-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-physics-splade-distil-cocodenser-medium.md index 46b6fc5a3e..708409c6a3 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-physics-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-physics-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-physics-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-physics-unicoil-noexp.md index 29d475c97c..ea51798df2 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-physics-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-physics-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat-wp.md index 47bac4d97d..b401ae8866 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat.md index 40c4671184..a70772a1b8 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-programmers-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-programmers-multifield.md index af64c65652..5914648d60 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-programmers-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-programmers-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-programmers-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-programmers-splade-distil-cocodenser-medium.md index cfe0d28b11..08e3b930b0 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-programmers-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-programmers-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-programmers-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-programmers-unicoil-noexp.md index dc7c67b439..53b43c38af 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-programmers-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-programmers-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-stats-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-stats-flat-wp.md index 35dbe27c88..ba737966f5 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-stats-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-stats-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-stats-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-stats-flat.md index 93d1e76bb6..1b01f8f1e6 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-stats-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-stats-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-stats-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-stats-multifield.md index 5eb1d99669..1c776bd440 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-stats-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-stats-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-stats-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-stats-splade-distil-cocodenser-medium.md index f4d282d5c4..20f5693b2c 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-stats-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-stats-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-stats-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-stats-unicoil-noexp.md index 733c3758ba..21d1abe5a7 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-stats-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-stats-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-tex-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-tex-flat-wp.md index c65cc7508c..ec750c9212 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-tex-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-tex-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-tex-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-tex-flat.md index 4056d7b210..0741b30ae3 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-tex-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-tex-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-tex-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-tex-multifield.md index c8448981af..9d5005434e 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-tex-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-tex-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-tex-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-tex-splade-distil-cocodenser-medium.md index 67ee7958dc..aad2382767 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-tex-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-tex-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-tex-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-tex-unicoil-noexp.md index d977ec8e47..1b64e9494c 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-tex-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-tex-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-unix-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-unix-flat-wp.md index 9c9a1f6cc0..fea668b74a 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-unix-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-unix-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-unix-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-unix-flat.md index 32c0be9640..ae2f52f453 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-unix-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-unix-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-unix-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-unix-multifield.md index 5c2bdbab11..17252bd3eb 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-unix-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-unix-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-unix-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-unix-splade-distil-cocodenser-medium.md index bfeffedb28..4cf18b27fa 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-unix-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-unix-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-unix-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-unix-unicoil-noexp.md index 3ce81369aa..8433eb3684 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-unix-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-unix-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat-wp.md index ce199b61aa..59f5787750 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat.md index 624b4d60b8..b10b309f8f 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-multifield.md index 7917328319..cc19993b03 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-splade-distil-cocodenser-medium.md index b1d02709fd..084ac61365 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-unicoil-noexp.md index b21cd67bb4..331cb39c7e 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-webmasters-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat-wp.md b/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat-wp.md index 8183e15e1d..dfc4609fd1 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat.md b/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat.md index 2d006eb858..9e2ee8812a 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-multifield.md b/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-multifield.md index dac72d5d4b..947deb21c9 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-multifield.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-splade-distil-cocodenser-medium.md index 7756a22779..8296bf386b 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-unicoil-noexp.md index 61ffc33c5f..351085c675 100644 --- a/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-cqadupstack-wordpress-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-dbpedia-entity-flat-wp.md b/docs/regressions-beir-v1.0.0-dbpedia-entity-flat-wp.md index 4b7bb55097..c86ef11f25 100644 --- a/docs/regressions-beir-v1.0.0-dbpedia-entity-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-dbpedia-entity-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-dbpedia-entity-flat.md b/docs/regressions-beir-v1.0.0-dbpedia-entity-flat.md index 6cd85bfe9b..73bd60316c 100644 --- a/docs/regressions-beir-v1.0.0-dbpedia-entity-flat.md +++ b/docs/regressions-beir-v1.0.0-dbpedia-entity-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-dbpedia-entity-multifield.md b/docs/regressions-beir-v1.0.0-dbpedia-entity-multifield.md index 6e6d7f6a2e..f819a0efde 100644 --- a/docs/regressions-beir-v1.0.0-dbpedia-entity-multifield.md +++ b/docs/regressions-beir-v1.0.0-dbpedia-entity-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-dbpedia-entity-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-dbpedia-entity-splade-distil-cocodenser-medium.md index d764709026..c8f57145a5 100644 --- a/docs/regressions-beir-v1.0.0-dbpedia-entity-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-dbpedia-entity-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-dbpedia-entity-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-dbpedia-entity-unicoil-noexp.md index 670d78256d..929b3043c9 100644 --- a/docs/regressions-beir-v1.0.0-dbpedia-entity-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-dbpedia-entity-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-fever-flat-wp.md b/docs/regressions-beir-v1.0.0-fever-flat-wp.md index b775cdccd4..c4b551c222 100644 --- a/docs/regressions-beir-v1.0.0-fever-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-fever-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-fever-flat.md b/docs/regressions-beir-v1.0.0-fever-flat.md index 653260ccbc..4cbb3963a6 100644 --- a/docs/regressions-beir-v1.0.0-fever-flat.md +++ b/docs/regressions-beir-v1.0.0-fever-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-fever-multifield.md b/docs/regressions-beir-v1.0.0-fever-multifield.md index 24bd5be81f..e31424c39a 100644 --- a/docs/regressions-beir-v1.0.0-fever-multifield.md +++ b/docs/regressions-beir-v1.0.0-fever-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-fever-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-fever-splade-distil-cocodenser-medium.md index ceaa104c3a..f5107895dd 100644 --- a/docs/regressions-beir-v1.0.0-fever-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-fever-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-fever-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-fever-unicoil-noexp.md index e78b6d52e9..6c76ba996e 100644 --- a/docs/regressions-beir-v1.0.0-fever-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-fever-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-fiqa-flat-wp.md b/docs/regressions-beir-v1.0.0-fiqa-flat-wp.md index 7a1a06d4c0..0cc03a0612 100644 --- a/docs/regressions-beir-v1.0.0-fiqa-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-fiqa-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-fiqa-flat.md b/docs/regressions-beir-v1.0.0-fiqa-flat.md index 8a68bb0890..e559240bd2 100644 --- a/docs/regressions-beir-v1.0.0-fiqa-flat.md +++ b/docs/regressions-beir-v1.0.0-fiqa-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-fiqa-multifield.md b/docs/regressions-beir-v1.0.0-fiqa-multifield.md index 9bd72b2159..9304b41dde 100644 --- a/docs/regressions-beir-v1.0.0-fiqa-multifield.md +++ b/docs/regressions-beir-v1.0.0-fiqa-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-fiqa-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-fiqa-splade-distil-cocodenser-medium.md index 84b9c49e48..83f84c97e0 100644 --- a/docs/regressions-beir-v1.0.0-fiqa-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-fiqa-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-fiqa-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-fiqa-unicoil-noexp.md index e2abcbee75..19a1bfd968 100644 --- a/docs/regressions-beir-v1.0.0-fiqa-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-fiqa-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-hotpotqa-flat-wp.md b/docs/regressions-beir-v1.0.0-hotpotqa-flat-wp.md index e629d776a5..3461ca071c 100644 --- a/docs/regressions-beir-v1.0.0-hotpotqa-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-hotpotqa-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-hotpotqa-flat.md b/docs/regressions-beir-v1.0.0-hotpotqa-flat.md index 6e76e253df..a472247fc9 100644 --- a/docs/regressions-beir-v1.0.0-hotpotqa-flat.md +++ b/docs/regressions-beir-v1.0.0-hotpotqa-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-hotpotqa-multifield.md b/docs/regressions-beir-v1.0.0-hotpotqa-multifield.md index c23bb07d6d..2f3b0842c1 100644 --- a/docs/regressions-beir-v1.0.0-hotpotqa-multifield.md +++ b/docs/regressions-beir-v1.0.0-hotpotqa-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-hotpotqa-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-hotpotqa-splade-distil-cocodenser-medium.md index 384e60433e..ebc7e436ce 100644 --- a/docs/regressions-beir-v1.0.0-hotpotqa-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-hotpotqa-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-hotpotqa-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-hotpotqa-unicoil-noexp.md index 77801be999..0cce5ebabb 100644 --- a/docs/regressions-beir-v1.0.0-hotpotqa-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-hotpotqa-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-nfcorpus-flat-wp.md b/docs/regressions-beir-v1.0.0-nfcorpus-flat-wp.md index a28bc03a85..f1db6e2b63 100644 --- a/docs/regressions-beir-v1.0.0-nfcorpus-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-nfcorpus-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-nfcorpus-flat.md b/docs/regressions-beir-v1.0.0-nfcorpus-flat.md index 09eacbef47..4d76fa86cd 100644 --- a/docs/regressions-beir-v1.0.0-nfcorpus-flat.md +++ b/docs/regressions-beir-v1.0.0-nfcorpus-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-nfcorpus-multifield.md b/docs/regressions-beir-v1.0.0-nfcorpus-multifield.md index 9ee0ac243c..ad2c374a84 100644 --- a/docs/regressions-beir-v1.0.0-nfcorpus-multifield.md +++ b/docs/regressions-beir-v1.0.0-nfcorpus-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-nfcorpus-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-nfcorpus-splade-distil-cocodenser-medium.md index 7765f4e1c0..2212f4f319 100644 --- a/docs/regressions-beir-v1.0.0-nfcorpus-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-nfcorpus-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-nfcorpus-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-nfcorpus-unicoil-noexp.md index 474ac08a3f..38016997eb 100644 --- a/docs/regressions-beir-v1.0.0-nfcorpus-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-nfcorpus-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-nq-flat-wp.md b/docs/regressions-beir-v1.0.0-nq-flat-wp.md index b54b5f1449..ba7a6902bd 100644 --- a/docs/regressions-beir-v1.0.0-nq-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-nq-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-nq-flat.md b/docs/regressions-beir-v1.0.0-nq-flat.md index 0089924da7..14c3863381 100644 --- a/docs/regressions-beir-v1.0.0-nq-flat.md +++ b/docs/regressions-beir-v1.0.0-nq-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-nq-multifield.md b/docs/regressions-beir-v1.0.0-nq-multifield.md index a6ae7b3cc2..d9e7239e85 100644 --- a/docs/regressions-beir-v1.0.0-nq-multifield.md +++ b/docs/regressions-beir-v1.0.0-nq-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-nq-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-nq-splade-distil-cocodenser-medium.md index 7838783783..0e25f508be 100644 --- a/docs/regressions-beir-v1.0.0-nq-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-nq-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-nq-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-nq-unicoil-noexp.md index c535852e0f..9432f4424c 100644 --- a/docs/regressions-beir-v1.0.0-nq-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-nq-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-quora-flat-wp.md b/docs/regressions-beir-v1.0.0-quora-flat-wp.md index f1a3b2e7ba..cbe6670c6d 100644 --- a/docs/regressions-beir-v1.0.0-quora-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-quora-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-quora-flat.md b/docs/regressions-beir-v1.0.0-quora-flat.md index 841a927747..207ca65daa 100644 --- a/docs/regressions-beir-v1.0.0-quora-flat.md +++ b/docs/regressions-beir-v1.0.0-quora-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-quora-multifield.md b/docs/regressions-beir-v1.0.0-quora-multifield.md index 0494500287..d5c76f3563 100644 --- a/docs/regressions-beir-v1.0.0-quora-multifield.md +++ b/docs/regressions-beir-v1.0.0-quora-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-quora-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-quora-splade-distil-cocodenser-medium.md index fe479dd8db..0875e672df 100644 --- a/docs/regressions-beir-v1.0.0-quora-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-quora-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-quora-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-quora-unicoil-noexp.md index 159d842357..fb9fffa922 100644 --- a/docs/regressions-beir-v1.0.0-quora-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-quora-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-robust04-flat-wp.md b/docs/regressions-beir-v1.0.0-robust04-flat-wp.md index 401d767629..bffda9781f 100644 --- a/docs/regressions-beir-v1.0.0-robust04-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-robust04-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-robust04-flat.md b/docs/regressions-beir-v1.0.0-robust04-flat.md index 15bd192229..317133ebf8 100644 --- a/docs/regressions-beir-v1.0.0-robust04-flat.md +++ b/docs/regressions-beir-v1.0.0-robust04-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-robust04-multifield.md b/docs/regressions-beir-v1.0.0-robust04-multifield.md index 09b4d43b67..6eb9497d4e 100644 --- a/docs/regressions-beir-v1.0.0-robust04-multifield.md +++ b/docs/regressions-beir-v1.0.0-robust04-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-robust04-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-robust04-splade-distil-cocodenser-medium.md index 9cc14e4ef0..675b6c46e4 100644 --- a/docs/regressions-beir-v1.0.0-robust04-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-robust04-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-robust04-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-robust04-unicoil-noexp.md index db7e40c7a8..3e8462f8d2 100644 --- a/docs/regressions-beir-v1.0.0-robust04-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-robust04-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-scidocs-flat-wp.md b/docs/regressions-beir-v1.0.0-scidocs-flat-wp.md index 0dd6c0b78b..2a1c9a3f7d 100644 --- a/docs/regressions-beir-v1.0.0-scidocs-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-scidocs-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-scidocs-flat.md b/docs/regressions-beir-v1.0.0-scidocs-flat.md index 0c5ecf1771..da1b49f775 100644 --- a/docs/regressions-beir-v1.0.0-scidocs-flat.md +++ b/docs/regressions-beir-v1.0.0-scidocs-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-scidocs-multifield.md b/docs/regressions-beir-v1.0.0-scidocs-multifield.md index 8a04c2828e..3119c3a43c 100644 --- a/docs/regressions-beir-v1.0.0-scidocs-multifield.md +++ b/docs/regressions-beir-v1.0.0-scidocs-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-scidocs-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-scidocs-splade-distil-cocodenser-medium.md index 5693dc112e..8cb17093a1 100644 --- a/docs/regressions-beir-v1.0.0-scidocs-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-scidocs-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-scidocs-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-scidocs-unicoil-noexp.md index b5415eca21..dc7834be7d 100644 --- a/docs/regressions-beir-v1.0.0-scidocs-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-scidocs-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-scifact-flat-wp.md b/docs/regressions-beir-v1.0.0-scifact-flat-wp.md index 98bb7c705a..26a29c7dfd 100644 --- a/docs/regressions-beir-v1.0.0-scifact-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-scifact-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-scifact-flat.md b/docs/regressions-beir-v1.0.0-scifact-flat.md index 585284f0d9..033820bf46 100644 --- a/docs/regressions-beir-v1.0.0-scifact-flat.md +++ b/docs/regressions-beir-v1.0.0-scifact-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-scifact-multifield.md b/docs/regressions-beir-v1.0.0-scifact-multifield.md index 284a0bb7a1..985809f785 100644 --- a/docs/regressions-beir-v1.0.0-scifact-multifield.md +++ b/docs/regressions-beir-v1.0.0-scifact-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-scifact-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-scifact-splade-distil-cocodenser-medium.md index fe7d486c54..cb6bfce243 100644 --- a/docs/regressions-beir-v1.0.0-scifact-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-scifact-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-scifact-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-scifact-unicoil-noexp.md index 5669ec7cfa..b8a7a1e5fa 100644 --- a/docs/regressions-beir-v1.0.0-scifact-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-scifact-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-signal1m-flat-wp.md b/docs/regressions-beir-v1.0.0-signal1m-flat-wp.md index 46e43d2965..c787e55d08 100644 --- a/docs/regressions-beir-v1.0.0-signal1m-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-signal1m-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-signal1m-flat.md b/docs/regressions-beir-v1.0.0-signal1m-flat.md index a76f90baf8..a8bb081aba 100644 --- a/docs/regressions-beir-v1.0.0-signal1m-flat.md +++ b/docs/regressions-beir-v1.0.0-signal1m-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-signal1m-multifield.md b/docs/regressions-beir-v1.0.0-signal1m-multifield.md index d9a8b964c8..467b0e1104 100644 --- a/docs/regressions-beir-v1.0.0-signal1m-multifield.md +++ b/docs/regressions-beir-v1.0.0-signal1m-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-signal1m-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-signal1m-splade-distil-cocodenser-medium.md index 76dfe2f2fd..b4ab7ea900 100644 --- a/docs/regressions-beir-v1.0.0-signal1m-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-signal1m-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-signal1m-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-signal1m-unicoil-noexp.md index 314dc748ca..e87d1db6c6 100644 --- a/docs/regressions-beir-v1.0.0-signal1m-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-signal1m-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-trec-covid-flat-wp.md b/docs/regressions-beir-v1.0.0-trec-covid-flat-wp.md index 6979601312..45c944970a 100644 --- a/docs/regressions-beir-v1.0.0-trec-covid-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-trec-covid-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-trec-covid-flat.md b/docs/regressions-beir-v1.0.0-trec-covid-flat.md index 0e53be02a6..1044afc984 100644 --- a/docs/regressions-beir-v1.0.0-trec-covid-flat.md +++ b/docs/regressions-beir-v1.0.0-trec-covid-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-trec-covid-multifield.md b/docs/regressions-beir-v1.0.0-trec-covid-multifield.md index 0973092b3a..98477edbd6 100644 --- a/docs/regressions-beir-v1.0.0-trec-covid-multifield.md +++ b/docs/regressions-beir-v1.0.0-trec-covid-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-trec-covid-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-trec-covid-splade-distil-cocodenser-medium.md index 75a5852176..ea75f0756d 100644 --- a/docs/regressions-beir-v1.0.0-trec-covid-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-trec-covid-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-trec-covid-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-trec-covid-unicoil-noexp.md index 09c2c02808..05ea0d06c8 100644 --- a/docs/regressions-beir-v1.0.0-trec-covid-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-trec-covid-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-trec-news-flat-wp.md b/docs/regressions-beir-v1.0.0-trec-news-flat-wp.md index c104a67359..93f1c3cacf 100644 --- a/docs/regressions-beir-v1.0.0-trec-news-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-trec-news-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-trec-news-flat.md b/docs/regressions-beir-v1.0.0-trec-news-flat.md index 605f3394e2..468df04070 100644 --- a/docs/regressions-beir-v1.0.0-trec-news-flat.md +++ b/docs/regressions-beir-v1.0.0-trec-news-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-trec-news-multifield.md b/docs/regressions-beir-v1.0.0-trec-news-multifield.md index a1918039f6..0d75dda90c 100644 --- a/docs/regressions-beir-v1.0.0-trec-news-multifield.md +++ b/docs/regressions-beir-v1.0.0-trec-news-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-trec-news-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-trec-news-splade-distil-cocodenser-medium.md index 0a0078a196..99d9d21e3b 100644 --- a/docs/regressions-beir-v1.0.0-trec-news-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-trec-news-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-trec-news-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-trec-news-unicoil-noexp.md index 50d30976ec..a819afd0ee 100644 --- a/docs/regressions-beir-v1.0.0-trec-news-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-trec-news-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-webis-touche2020-flat-wp.md b/docs/regressions-beir-v1.0.0-webis-touche2020-flat-wp.md index 1030046cb9..7676e73073 100644 --- a/docs/regressions-beir-v1.0.0-webis-touche2020-flat-wp.md +++ b/docs/regressions-beir-v1.0.0-webis-touche2020-flat-wp.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-webis-touche2020-flat.md b/docs/regressions-beir-v1.0.0-webis-touche2020-flat.md index 291d233d1f..7056f150b6 100644 --- a/docs/regressions-beir-v1.0.0-webis-touche2020-flat.md +++ b/docs/regressions-beir-v1.0.0-webis-touche2020-flat.md @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-webis-touche2020-multifield.md b/docs/regressions-beir-v1.0.0-webis-touche2020-multifield.md index de2d652b2a..13664ef645 100644 --- a/docs/regressions-beir-v1.0.0-webis-touche2020-multifield.md +++ b/docs/regressions-beir-v1.0.0-webis-touche2020-multifield.md @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-beir-v1.0.0-webis-touche2020-splade-distil-cocodenser-medium.md b/docs/regressions-beir-v1.0.0-webis-touche2020-splade-distil-cocodenser-medium.md index 0417909a06..5f4da02c6d 100644 --- a/docs/regressions-beir-v1.0.0-webis-touche2020-splade-distil-cocodenser-medium.md +++ b/docs/regressions-beir-v1.0.0-webis-touche2020-splade-distil-cocodenser-medium.md @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-beir-v1.0.0-webis-touche2020-unicoil-noexp.md b/docs/regressions-beir-v1.0.0-webis-touche2020-unicoil-noexp.md index 34a2ee5baf..9eecbf7c0f 100644 --- a/docs/regressions-beir-v1.0.0-webis-touche2020-unicoil-noexp.md +++ b/docs/regressions-beir-v1.0.0-webis-touche2020-unicoil-noexp.md @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/docs/regressions-car17v1.5.md b/docs/regressions-car17v1.5.md index 4c8f9ef331..fcf5de5d56 100644 --- a/docs/regressions-car17v1.5.md +++ b/docs/regressions-car17v1.5.md @@ -32,10 +32,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -The "benchmarkY1-test" topics and qrels (v1.5) are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): +The "benchmarkY1-test" topics and qrels (v1.5) are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): -+ [`topics.car17v1.5.benchmarkY1test.txt`](../tools/topics-and-qrels/topics.car17v1.5.benchmarkY1test.txt) -+ [`qrels.car17v1.5.benchmarkY1test.txt`](../tools/topics-and-qrels/qrels.car17v1.5.benchmarkY1test.txt) ++ [`topics.car17v1.5.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.car17v1.5.benchmarkY1test.txt) ++ [`qrels.car17v1.5.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.car17v1.5.benchmarkY1test.txt) Specifically, this is the section-level passage retrieval task with automatic ground truth. diff --git a/docs/regressions-car17v2.0-doc2query.md b/docs/regressions-car17v2.0-doc2query.md index b1e577e2f0..e56a6a10f7 100644 --- a/docs/regressions-car17v2.0-doc2query.md +++ b/docs/regressions-car17v2.0-doc2query.md @@ -38,10 +38,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -The "benchmarkY1-test" topics and qrels (v2.0) are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): +The "benchmarkY1-test" topics and qrels (v2.0) are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): -+ [`topics.car17v2.0.benchmarkY1test.txt`](../tools/topics-and-qrels/topics.car17v2.0.benchmarkY1test.txt) -+ [`qrels.car17v2.0.benchmarkY1test.txt`](../tools/topics-and-qrels/qrels.car17v2.0.benchmarkY1test.txt) ++ [`topics.car17v2.0.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.car17v2.0.benchmarkY1test.txt) ++ [`qrels.car17v2.0.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.car17v2.0.benchmarkY1test.txt) Specifically, this is the section-level passage retrieval task with automatic ground truth. diff --git a/docs/regressions-car17v2.0.md b/docs/regressions-car17v2.0.md index 92dbb0eedd..647a39fba4 100644 --- a/docs/regressions-car17v2.0.md +++ b/docs/regressions-car17v2.0.md @@ -32,10 +32,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -The "benchmarkY1-test" topics and qrels (v2.0) are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): +The "benchmarkY1-test" topics and qrels (v2.0) are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): -+ [`topics.car17v2.0.benchmarkY1test.txt`](../tools/topics-and-qrels/topics.car17v2.0.benchmarkY1test.txt) -+ [`qrels.car17v2.0.benchmarkY1test.txt`](../tools/topics-and-qrels/qrels.car17v2.0.benchmarkY1test.txt) ++ [`topics.car17v2.0.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.car17v2.0.benchmarkY1test.txt) ++ [`qrels.car17v2.0.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.car17v2.0.benchmarkY1test.txt) Specifically, this is the section-level passage retrieval task with automatic ground truth. diff --git a/docs/regressions-clef06-fr.md b/docs/regressions-clef06-fr.md index dbe52f9846..9fddd94cdc 100644 --- a/docs/regressions-clef06-fr.md +++ b/docs/regressions-clef06-fr.md @@ -34,10 +34,10 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), from the [CLEF test suites pages](http://www.clef-initiative.eu/dataset/corpus): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. -+ [`topics.clef06fr.mono.fr.txt`](../tools/topics-and-qrels/topics.clef06fr.mono.fr.txt): CLEF 2006 ad hoc track topics in French -+ [`qrels.clef06fr.txt`](../tools/topics-and-qrels/qrels.clef06fr.txt): CLEF 2006 ad hoc track French relevance judgements ++ [`topics.clef06fr.mono.fr.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.clef06fr.mono.fr.txt): CLEF 2006 ad hoc track topics in French ++ [`qrels.clef06fr.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.clef06fr.txt): CLEF 2006 ad hoc track French relevance judgements After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-core17.md b/docs/regressions-core17.md index 2809d59f84..b6d7f37400 100644 --- a/docs/regressions-core17.md +++ b/docs/regressions-core17.md @@ -33,10 +33,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.core17.txt`](../tools/topics-and-qrels/topics.core17.txt): [topics for the TREC 2017 Common Core Track](https://trec.nist.gov/data/core/core_nist.txt) -+ [`qrels.core17.txt`](../tools/topics-and-qrels/qrels.core17.txt): [qrels for the TREC 2017 Common Core Track](https://trec.nist.gov/data/core/qrels.txt) ++ [`topics.core17.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.core17.txt): [topics for the TREC 2017 Common Core Track](https://trec.nist.gov/data/core/core_nist.txt) ++ [`qrels.core17.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.core17.txt): [qrels for the TREC 2017 Common Core Track](https://trec.nist.gov/data/core/qrels.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-core18.md b/docs/regressions-core18.md index 6a6504aa2b..d20dc0ca58 100644 --- a/docs/regressions-core18.md +++ b/docs/regressions-core18.md @@ -33,10 +33,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.core18.txt`](../tools/topics-and-qrels/topics.core18.txt): [topics for the TREC 2018 Common Core Track](https://trec.nist.gov/data/core/topics2018.txt) -+ [`qrels.core18.txt`](../tools/topics-and-qrels/qrels.core18.txt): [qrels for the TREC 2018 Common Core Track](https://trec.nist.gov/data/core/qrels2018.txt) ++ [`topics.core18.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.core18.txt): [topics for the TREC 2018 Common Core Track](https://trec.nist.gov/data/core/topics2018.txt) ++ [`qrels.core18.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.core18.txt): [qrels for the TREC 2018 Common Core Track](https://trec.nist.gov/data/core/qrels2018.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-cw09b.md b/docs/regressions-cw09b.md index 9a2c396836..d296af6887 100644 --- a/docs/regressions-cw09b.md +++ b/docs/regressions-cw09b.md @@ -32,16 +32,17 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: - -+ [`topics.web.1-50.txt`](../tools/topics-and-qrels/topics.web.1-50.txt): [topics for the TREC 2009 Web Track (Topics 1-50)](http://trec.nist.gov/data/web/09/wt09.topics.full.xml) -+ [`topics.web.51-100.txt`](../tools/topics-and-qrels/topics.web.51-100.txt): [topics for the TREC 2010 Web Track (Topics 51-100)](http://trec.nist.gov/data/web/10/wt2010-topics.xml) -+ [`topics.web.101-150.txt`](../tools/topics-and-qrels/topics.web.101-150.txt): [topics for the TREC 2011 Web Track (Topics 101-150)](http://trec.nist.gov/data/web/11/full-topics.xml) -+ [`topics.web.151-200.txt`](../tools/topics-and-qrels/topics.web.151-200.txt): [topics for the TREC 2012 Web Track (Topics 151-200)](http://trec.nist.gov/data/web/12/full-topics.xml) -+ [`prels.web.1-50.txt`](../tools/topics-and-qrels/prels.web.1-50.txt): [prels for the TREC 2009 Web Track (Topics 1-50, category B runs)](http://trec.nist.gov/data/web/09/prels.catB.1-50.gz) -+ [`qrels.web.51-100.txt`](../tools/topics-and-qrels/qrels.web.51-100.txt): [qrels for the TREC 2010 Web Track (Topics 51-100)](http://trec.nist.gov/data/web/10/10.adhoc-qrels.final) -+ [`qrels.web.101-150.txt`](../tools/topics-and-qrels/qrels.web.101-150.txt): [qrels for the TREC 2011 Web Track (Topics 101-150)](http://trec.nist.gov/data/web/11/qrels.adhoc) -+ [`qrels.web.151-200.txt`](../tools/topics-and-qrels/qrels.web.151-200.txt): [qrels for the TREC 2012 Web Track (Topics 151-200)](http://trec.nist.gov/data/web/12/qrels.adhoc) +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: + ++ [`topics.web.1-50.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.1-50.txt): [topics for the TREC 2009 Web Track (Topics 1-50)](http://trec.nist.gov/data/web/09/wt09.topics.full.xml) ++ [`topics.web.51-100.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.51-100.txt): [topics for the TREC 2010 Web Track (Topics 51-100)](http://trec.nist.gov/data/web/10/wt2010-topics.xml) ++ [`topics.web.101-150.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.101-150.txt): [topics for the TREC 2011 Web Track (Topics 101-150)](http://trec.nist.gov/data/web/11/full-topics.xml) ++ [`topics.web.151-200.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.151-200.txt): [topics for the TREC 2012 Web Track (Topics 151-200)](http://trec.nist.gov/data/web/12/full-topics.xml) ++ [`prels.web.1-50.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/prels.web.1-50.txt): [prels for the TREC 2009 Web Track (Topics 1-50, category B runs)](http://trec.nist.gov/data/web/09/prels.catB.1-50.gz) ++ [`qrels.web.51-100.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.51-100.txt): [qrels for the TREC 2010 Web Track (Topics 51-100)](http://trec.nist.gov/data/web/10/10.adhoc-qrels.final) ++ [`qrels.web.101-150.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.101-150.txt): [qrels for the TREC 2011 Web Track (Topics 101-150)](http://trec.nist.gov/data/web/11/qrels.adhoc) ++ [`qrels.web.151-200.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.151-200.txt): [qrels for the TREC 2012 Web Track (Topics 151-200)](http://trec.nist.gov/data/web/12/qrels.adhoc) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-cw12.md b/docs/regressions-cw12.md index 732820a83b..7e2d95d8f4 100644 --- a/docs/regressions-cw12.md +++ b/docs/regressions-cw12.md @@ -32,12 +32,13 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.web.201-250.txt`](../tools/topics-and-qrels/topics.web.201-250.txt): [topics for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/trec2013-topics.xml) -+ [`topics.web.251-300.txt`](../tools/topics-and-qrels/topics.web.251-300.txt): [topics for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/trec2014-topics.xml) -+ [`qrels.web.201-250.txt`](../tools/topics-and-qrels/qrels.web.201-250.txt): [one aspect per topic qrels for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/qrels.adhoc.txt) -+ [`qrels.web.251-300.txt`](../tools/topics-and-qrels/qrels.web.251-300.txt): [one aspect per topic qrels for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/qrels.adhoc.txt) ++ [`topics.web.201-250.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.201-250.txt): [topics for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/trec2013-topics.xml) ++ [`topics.web.251-300.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.251-300.txt): [topics for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/trec2014-topics.xml) ++ [`qrels.web.201-250.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.201-250.txt): [one aspect per topic qrels for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/qrels.adhoc.txt) ++ [`qrels.web.251-300.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.251-300.txt): [one aspect per topic qrels for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/qrels.adhoc.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-cw12b13.md b/docs/regressions-cw12b13.md index 35954dbdeb..578ad16da8 100644 --- a/docs/regressions-cw12b13.md +++ b/docs/regressions-cw12b13.md @@ -32,12 +32,13 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.web.201-250.txt`](../tools/topics-and-qrels/topics.web.201-250.txt): [topics for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/trec2013-topics.xml) -+ [`topics.web.251-300.txt`](../tools/topics-and-qrels/topics.web.251-300.txt): [topics for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/trec2014-topics.xml) -+ [`qrels.web.201-250.txt`](../tools/topics-and-qrels/qrels.web.201-250.txt): [one aspect per topic qrels for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/qrels.adhoc.txt) -+ [`qrels.web.251-300.txt`](../tools/topics-and-qrels/qrels.web.251-300.txt): [one aspect per topic qrels for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/qrels.adhoc.txt) ++ [`topics.web.201-250.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.201-250.txt): [topics for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/trec2013-topics.xml) ++ [`topics.web.251-300.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.251-300.txt): [topics for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/trec2014-topics.xml) ++ [`qrels.web.201-250.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.201-250.txt): [one aspect per topic qrels for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/qrels.adhoc.txt) ++ [`qrels.web.251-300.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.251-300.txt): [one aspect per topic qrels for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/qrels.adhoc.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-disk12.md b/docs/regressions-disk12.md index 56e8d4efae..ad2b28678f 100644 --- a/docs/regressions-disk12.md +++ b/docs/regressions-disk12.md @@ -32,14 +32,15 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: - -+ [`topics.adhoc.51-100.txt`](../tools/topics-and-qrels/topics.adhoc.51-100.txt): [TREC-1 Ad Hoc Topics 51-100](http://trec.nist.gov/data/topics_eng/) -+ [`topics.adhoc.101-150.txt`](../tools/topics-and-qrels/topics.adhoc.101-150.txt): [TREC-2 Ad Hoc Topics 101-150](http://trec.nist.gov/data/topics_eng/) -+ [`topics.adhoc.151-200.txt`](../tools/topics-and-qrels/topics.adhoc.151-200.txt): [TREC-3 Ad Hoc Topics 151-200](http://trec.nist.gov/data/topics_eng/) -+ [`qrels.adhoc.51-100.txt`](../tools/topics-and-qrels/qrels.adhoc.51-100.txt): [qrels for TREC-1 Ad Hoc Topics 51-100](http://trec.nist.gov/data/qrels_eng/) -+ [`qrels.adhoc.101-150.txt`](../tools/topics-and-qrels/qrels.adhoc.101-150.txt): [qrels for TREC-2 Ad Hoc Topics 101-150](http://trec.nist.gov/data/qrels_eng/) -+ [`qrels.adhoc.151-200.txt`](../tools/topics-and-qrels/qrels.adhoc.151-200.txt): [qrels for TREC-3 Ad Hoc Topics 151-200](http://trec.nist.gov/data/qrels_eng/) +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: + ++ [`topics.adhoc.51-100.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.51-100.txt): [TREC-1 Ad Hoc Topics 51-100](http://trec.nist.gov/data/topics_eng/) ++ [`topics.adhoc.101-150.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.101-150.txt): [TREC-2 Ad Hoc Topics 101-150](http://trec.nist.gov/data/topics_eng/) ++ [`topics.adhoc.151-200.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.151-200.txt): [TREC-3 Ad Hoc Topics 151-200](http://trec.nist.gov/data/topics_eng/) ++ [`qrels.adhoc.51-100.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.51-100.txt): [qrels for TREC-1 Ad Hoc Topics 51-100](http://trec.nist.gov/data/qrels_eng/) ++ [`qrels.adhoc.101-150.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.101-150.txt): [qrels for TREC-2 Ad Hoc Topics 101-150](http://trec.nist.gov/data/qrels_eng/) ++ [`qrels.adhoc.151-200.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.151-200.txt): [qrels for TREC-3 Ad Hoc Topics 151-200](http://trec.nist.gov/data/qrels_eng/) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-disk45.md b/docs/regressions-disk45.md index ee02f243dd..c5c6e0e18d 100644 --- a/docs/regressions-disk45.md +++ b/docs/regressions-disk45.md @@ -33,12 +33,13 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.adhoc.351-400.txt`](../tools/topics-and-qrels/topics.adhoc.351-400.txt): [TREC-7 Ad Hoc Topics 351-400](http://trec.nist.gov/data/topics_eng/) -+ [`topics.adhoc.401-450.txt`](../tools/topics-and-qrels/topics.adhoc.401-450.txt): [TREC-8 Ad Hoc Topics 401-450](http://trec.nist.gov/data/topics_eng/) -+ [`qrels.adhoc.351-400.txt`](../tools/topics-and-qrels/qrels.adhoc.351-400.txt): [qrels for TREC-7 Ad Hoc Topics 351-400](http://trec.nist.gov/data/qrels_eng/) -+ [`qrels.adhoc.401-450.txt`](../tools/topics-and-qrels/qrels.adhoc.401-450.txt): [qrels for TREC-8 Ad Hoc Topics 401-450](http://trec.nist.gov/data/qrels_eng/) ++ [`topics.adhoc.351-400.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.351-400.txt): [TREC-7 Ad Hoc Topics 351-400](http://trec.nist.gov/data/topics_eng/) ++ [`topics.adhoc.401-450.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.401-450.txt): [TREC-8 Ad Hoc Topics 401-450](http://trec.nist.gov/data/topics_eng/) ++ [`qrels.adhoc.351-400.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.351-400.txt): [qrels for TREC-7 Ad Hoc Topics 351-400](http://trec.nist.gov/data/qrels_eng/) ++ [`qrels.adhoc.401-450.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.401-450.txt): [qrels for TREC-8 Ad Hoc Topics 401-450](http://trec.nist.gov/data/qrels_eng/) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-dl19-doc-ca.md b/docs/regressions-dl19-doc-ca.md index de3f38ab5b..a1c694a475 100644 --- a/docs/regressions-dl19-doc-ca.md +++ b/docs/regressions-dl19-doc-ca.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-doc-docTTTTTquery.md b/docs/regressions-dl19-doc-docTTTTTquery.md index 289974a1e0..e8fe21693c 100644 --- a/docs/regressions-dl19-doc-docTTTTTquery.md +++ b/docs/regressions-dl19-doc-docTTTTTquery.md @@ -48,7 +48,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-doc-hgf-wp.md b/docs/regressions-dl19-doc-hgf-wp.md index 7c4b0ca372..b1506b76ee 100644 --- a/docs/regressions-dl19-doc-hgf-wp.md +++ b/docs/regressions-dl19-doc-hgf-wp.md @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-doc-segmented-ca.md b/docs/regressions-dl19-doc-segmented-ca.md index e2ca1ec77c..af6c547579 100644 --- a/docs/regressions-dl19-doc-segmented-ca.md +++ b/docs/regressions-dl19-doc-segmented-ca.md @@ -46,7 +46,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-doc-segmented-docTTTTTquery.md b/docs/regressions-dl19-doc-segmented-docTTTTTquery.md index 477069a21c..0835db7b69 100644 --- a/docs/regressions-dl19-doc-segmented-docTTTTTquery.md +++ b/docs/regressions-dl19-doc-segmented-docTTTTTquery.md @@ -49,7 +49,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-doc-segmented-unicoil-noexp.md b/docs/regressions-dl19-doc-segmented-unicoil-noexp.md index 375f346534..e03afed790 100644 --- a/docs/regressions-dl19-doc-segmented-unicoil-noexp.md +++ b/docs/regressions-dl19-doc-segmented-unicoil-noexp.md @@ -71,7 +71,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-doc-segmented-unicoil.md b/docs/regressions-dl19-doc-segmented-unicoil.md index d48d589f42..113668b25a 100644 --- a/docs/regressions-dl19-doc-segmented-unicoil.md +++ b/docs/regressions-dl19-doc-segmented-unicoil.md @@ -71,7 +71,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-doc-segmented-wp.md b/docs/regressions-dl19-doc-segmented-wp.md index 58a9598b46..5c52f3b58e 100644 --- a/docs/regressions-dl19-doc-segmented-wp.md +++ b/docs/regressions-dl19-doc-segmented-wp.md @@ -39,7 +39,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-doc-segmented.md b/docs/regressions-dl19-doc-segmented.md index 8eda532f67..e1e11c6fe8 100644 --- a/docs/regressions-dl19-doc-segmented.md +++ b/docs/regressions-dl19-doc-segmented.md @@ -49,7 +49,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-doc-wp.md b/docs/regressions-dl19-doc-wp.md index fd65a68844..53454a0e2f 100644 --- a/docs/regressions-dl19-doc-wp.md +++ b/docs/regressions-dl19-doc-wp.md @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-doc.md b/docs/regressions-dl19-doc.md index eef3b7433a..687a8add8d 100644 --- a/docs/regressions-dl19-doc.md +++ b/docs/regressions-dl19-doc.md @@ -48,7 +48,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-bm25-b8.md b/docs/regressions-dl19-passage-bm25-b8.md index cd30a9f5fe..efb359b43a 100644 --- a/docs/regressions-dl19-passage-bm25-b8.md +++ b/docs/regressions-dl19-passage-bm25-b8.md @@ -61,7 +61,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-ca.md b/docs/regressions-dl19-passage-ca.md index 0b753d1a3c..e233077d3f 100644 --- a/docs/regressions-dl19-passage-ca.md +++ b/docs/regressions-dl19-passage-ca.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-docTTTTTquery.md b/docs/regressions-dl19-passage-docTTTTTquery.md index e599890ecc..dc22c7e8a7 100644 --- a/docs/regressions-dl19-passage-docTTTTTquery.md +++ b/docs/regressions-dl19-passage-docTTTTTquery.md @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-hgf-wp.md b/docs/regressions-dl19-passage-hgf-wp.md index d4830cfe69..d00e7a8c86 100644 --- a/docs/regressions-dl19-passage-hgf-wp.md +++ b/docs/regressions-dl19-passage-hgf-wp.md @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-splade-distil-cocodenser-medium.md b/docs/regressions-dl19-passage-splade-distil-cocodenser-medium.md index 11abd537ad..9e94c3a861 100644 --- a/docs/regressions-dl19-passage-splade-distil-cocodenser-medium.md +++ b/docs/regressions-dl19-passage-splade-distil-cocodenser-medium.md @@ -68,7 +68,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-splade-pp-ed-onnx.md b/docs/regressions-dl19-passage-splade-pp-ed-onnx.md index 57dc73eb01..528f9910e1 100644 --- a/docs/regressions-dl19-passage-splade-pp-ed-onnx.md +++ b/docs/regressions-dl19-passage-splade-pp-ed-onnx.md @@ -70,7 +70,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-splade-pp-ed.md b/docs/regressions-dl19-passage-splade-pp-ed.md index 92e13ab65f..588a50d444 100644 --- a/docs/regressions-dl19-passage-splade-pp-ed.md +++ b/docs/regressions-dl19-passage-splade-pp-ed.md @@ -70,7 +70,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-splade-pp-sd-onnx.md b/docs/regressions-dl19-passage-splade-pp-sd-onnx.md index 8358b0a4c7..74c2b6f721 100644 --- a/docs/regressions-dl19-passage-splade-pp-sd-onnx.md +++ b/docs/regressions-dl19-passage-splade-pp-sd-onnx.md @@ -70,7 +70,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-splade-pp-sd.md b/docs/regressions-dl19-passage-splade-pp-sd.md index 69fc3207ca..76132418b7 100644 --- a/docs/regressions-dl19-passage-splade-pp-sd.md +++ b/docs/regressions-dl19-passage-splade-pp-sd.md @@ -70,7 +70,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-unicoil-noexp.md b/docs/regressions-dl19-passage-unicoil-noexp.md index 70c676c1df..41e6ed5443 100644 --- a/docs/regressions-dl19-passage-unicoil-noexp.md +++ b/docs/regressions-dl19-passage-unicoil-noexp.md @@ -73,7 +73,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-unicoil.md b/docs/regressions-dl19-passage-unicoil.md index 4c5c639bae..ea0fe9985b 100644 --- a/docs/regressions-dl19-passage-unicoil.md +++ b/docs/regressions-dl19-passage-unicoil.md @@ -73,7 +73,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage-wp.md b/docs/regressions-dl19-passage-wp.md index 791bb997ad..d294e837d7 100644 --- a/docs/regressions-dl19-passage-wp.md +++ b/docs/regressions-dl19-passage-wp.md @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl19-passage.md b/docs/regressions-dl19-passage.md index 79db9341c2..24f8b90482 100644 --- a/docs/regressions-dl19-passage.md +++ b/docs/regressions-dl19-passage.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/docs/regressions-dl20-doc-ca.md b/docs/regressions-dl20-doc-ca.md index 18981313de..b8d6e64a46 100644 --- a/docs/regressions-dl20-doc-ca.md +++ b/docs/regressions-dl20-doc-ca.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-doc-docTTTTTquery.md b/docs/regressions-dl20-doc-docTTTTTquery.md index 54c03bb9c2..115c61780b 100644 --- a/docs/regressions-dl20-doc-docTTTTTquery.md +++ b/docs/regressions-dl20-doc-docTTTTTquery.md @@ -48,7 +48,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-doc-hgf-wp.md b/docs/regressions-dl20-doc-hgf-wp.md index 8a3472fdda..29c34fd6c2 100644 --- a/docs/regressions-dl20-doc-hgf-wp.md +++ b/docs/regressions-dl20-doc-hgf-wp.md @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-doc-segmented-ca.md b/docs/regressions-dl20-doc-segmented-ca.md index 2d5e8536f2..6438fcfb4c 100644 --- a/docs/regressions-dl20-doc-segmented-ca.md +++ b/docs/regressions-dl20-doc-segmented-ca.md @@ -46,7 +46,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-doc-segmented-docTTTTTquery.md b/docs/regressions-dl20-doc-segmented-docTTTTTquery.md index a449be80f2..1ed5af96ce 100644 --- a/docs/regressions-dl20-doc-segmented-docTTTTTquery.md +++ b/docs/regressions-dl20-doc-segmented-docTTTTTquery.md @@ -49,7 +49,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-doc-segmented-unicoil-noexp.md b/docs/regressions-dl20-doc-segmented-unicoil-noexp.md index a45a63ad8a..baa7cb8cd4 100644 --- a/docs/regressions-dl20-doc-segmented-unicoil-noexp.md +++ b/docs/regressions-dl20-doc-segmented-unicoil-noexp.md @@ -71,7 +71,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-doc-segmented-unicoil.md b/docs/regressions-dl20-doc-segmented-unicoil.md index dbb81701bc..896345db97 100644 --- a/docs/regressions-dl20-doc-segmented-unicoil.md +++ b/docs/regressions-dl20-doc-segmented-unicoil.md @@ -71,7 +71,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-doc-segmented-wp.md b/docs/regressions-dl20-doc-segmented-wp.md index e914f490e0..ae9a26203f 100644 --- a/docs/regressions-dl20-doc-segmented-wp.md +++ b/docs/regressions-dl20-doc-segmented-wp.md @@ -39,7 +39,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-doc-segmented.md b/docs/regressions-dl20-doc-segmented.md index 1a1c85cf14..c22207723a 100644 --- a/docs/regressions-dl20-doc-segmented.md +++ b/docs/regressions-dl20-doc-segmented.md @@ -49,7 +49,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-doc-wp.md b/docs/regressions-dl20-doc-wp.md index 9775a284c3..18e4dc71ce 100644 --- a/docs/regressions-dl20-doc-wp.md +++ b/docs/regressions-dl20-doc-wp.md @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-doc.md b/docs/regressions-dl20-doc.md index ec2f4ab818..aae3d38010 100644 --- a/docs/regressions-dl20-doc.md +++ b/docs/regressions-dl20-doc.md @@ -48,7 +48,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-bm25-b8.md b/docs/regressions-dl20-passage-bm25-b8.md index 1b60936e68..733215be26 100644 --- a/docs/regressions-dl20-passage-bm25-b8.md +++ b/docs/regressions-dl20-passage-bm25-b8.md @@ -61,7 +61,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-ca.md b/docs/regressions-dl20-passage-ca.md index 2ada1c156c..1c8179477c 100644 --- a/docs/regressions-dl20-passage-ca.md +++ b/docs/regressions-dl20-passage-ca.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-docTTTTTquery.md b/docs/regressions-dl20-passage-docTTTTTquery.md index ebfaeea36a..8e5e566c71 100644 --- a/docs/regressions-dl20-passage-docTTTTTquery.md +++ b/docs/regressions-dl20-passage-docTTTTTquery.md @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-hgf-wp.md b/docs/regressions-dl20-passage-hgf-wp.md index 419ca2ecb6..d6b35fc44c 100644 --- a/docs/regressions-dl20-passage-hgf-wp.md +++ b/docs/regressions-dl20-passage-hgf-wp.md @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-splade-distil-cocodenser-medium.md b/docs/regressions-dl20-passage-splade-distil-cocodenser-medium.md index 0d571180a2..87ab79d8e7 100644 --- a/docs/regressions-dl20-passage-splade-distil-cocodenser-medium.md +++ b/docs/regressions-dl20-passage-splade-distil-cocodenser-medium.md @@ -68,7 +68,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-splade-pp-ed-onnx.md b/docs/regressions-dl20-passage-splade-pp-ed-onnx.md index 458a88c6da..ac24e02902 100644 --- a/docs/regressions-dl20-passage-splade-pp-ed-onnx.md +++ b/docs/regressions-dl20-passage-splade-pp-ed-onnx.md @@ -70,7 +70,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-splade-pp-ed.md b/docs/regressions-dl20-passage-splade-pp-ed.md index b6373defe6..1f729b2f92 100644 --- a/docs/regressions-dl20-passage-splade-pp-ed.md +++ b/docs/regressions-dl20-passage-splade-pp-ed.md @@ -70,7 +70,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-splade-pp-sd-onnx.md b/docs/regressions-dl20-passage-splade-pp-sd-onnx.md index 1e4c1a3b25..12679aef53 100644 --- a/docs/regressions-dl20-passage-splade-pp-sd-onnx.md +++ b/docs/regressions-dl20-passage-splade-pp-sd-onnx.md @@ -70,7 +70,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-splade-pp-sd.md b/docs/regressions-dl20-passage-splade-pp-sd.md index 18a01df0d2..a47dac9952 100644 --- a/docs/regressions-dl20-passage-splade-pp-sd.md +++ b/docs/regressions-dl20-passage-splade-pp-sd.md @@ -70,7 +70,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-unicoil-noexp.md b/docs/regressions-dl20-passage-unicoil-noexp.md index 9e1fcb8930..1abf8ce33b 100644 --- a/docs/regressions-dl20-passage-unicoil-noexp.md +++ b/docs/regressions-dl20-passage-unicoil-noexp.md @@ -73,7 +73,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-unicoil.md b/docs/regressions-dl20-passage-unicoil.md index 93e9f2b7b2..5096ff775a 100644 --- a/docs/regressions-dl20-passage-unicoil.md +++ b/docs/regressions-dl20-passage-unicoil.md @@ -73,7 +73,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage-wp.md b/docs/regressions-dl20-passage-wp.md index d47a991b67..9efd73824c 100644 --- a/docs/regressions-dl20-passage-wp.md +++ b/docs/regressions-dl20-passage-wp.md @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl20-passage.md b/docs/regressions-dl20-passage.md index ecc838ad9e..c0feb1f846 100644 --- a/docs/regressions-dl20-passage.md +++ b/docs/regressions-dl20-passage.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/docs/regressions-dl21-doc-d2q-t5.md b/docs/regressions-dl21-doc-d2q-t5.md index 1c24bd7668..e04f18e9a4 100644 --- a/docs/regressions-dl21-doc-d2q-t5.md +++ b/docs/regressions-dl21-doc-d2q-t5.md @@ -42,7 +42,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-doc-segmented-d2q-t5.md b/docs/regressions-dl21-doc-segmented-d2q-t5.md index 7cb26a75eb..6f48dfebb0 100644 --- a/docs/regressions-dl21-doc-segmented-d2q-t5.md +++ b/docs/regressions-dl21-doc-segmented-d2q-t5.md @@ -42,7 +42,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-doc-segmented-unicoil-0shot-v2.md b/docs/regressions-dl21-doc-segmented-unicoil-0shot-v2.md index f847648ee8..0d7fbb4743 100644 --- a/docs/regressions-dl21-doc-segmented-unicoil-0shot-v2.md +++ b/docs/regressions-dl21-doc-segmented-unicoil-0shot-v2.md @@ -84,7 +84,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-doc-segmented-unicoil-0shot.md b/docs/regressions-dl21-doc-segmented-unicoil-0shot.md index 0370d654b6..ce91e9cb63 100644 --- a/docs/regressions-dl21-doc-segmented-unicoil-0shot.md +++ b/docs/regressions-dl21-doc-segmented-unicoil-0shot.md @@ -83,7 +83,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-doc-segmented-unicoil-noexp-0shot-v2.md b/docs/regressions-dl21-doc-segmented-unicoil-noexp-0shot-v2.md index a0d6a4c02e..7c96d58abb 100644 --- a/docs/regressions-dl21-doc-segmented-unicoil-noexp-0shot-v2.md +++ b/docs/regressions-dl21-doc-segmented-unicoil-noexp-0shot-v2.md @@ -84,7 +84,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-doc-segmented-unicoil-noexp-0shot.md b/docs/regressions-dl21-doc-segmented-unicoil-noexp-0shot.md index dd47ad5df6..b0fa98bc15 100644 --- a/docs/regressions-dl21-doc-segmented-unicoil-noexp-0shot.md +++ b/docs/regressions-dl21-doc-segmented-unicoil-noexp-0shot.md @@ -83,7 +83,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-doc-segmented.md b/docs/regressions-dl21-doc-segmented.md index af222675f9..46cb451850 100644 --- a/docs/regressions-dl21-doc-segmented.md +++ b/docs/regressions-dl21-doc-segmented.md @@ -42,7 +42,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-doc.md b/docs/regressions-dl21-doc.md index f984047970..c33f195ff1 100644 --- a/docs/regressions-dl21-doc.md +++ b/docs/regressions-dl21-doc.md @@ -42,7 +42,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-passage-augmented-d2q-t5.md b/docs/regressions-dl21-passage-augmented-d2q-t5.md index 31edda80ad..0d66ba4984 100644 --- a/docs/regressions-dl21-passage-augmented-d2q-t5.md +++ b/docs/regressions-dl21-passage-augmented-d2q-t5.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-passage-augmented.md b/docs/regressions-dl21-passage-augmented.md index b9f18c4723..85d94e9ae8 100644 --- a/docs/regressions-dl21-passage-augmented.md +++ b/docs/regressions-dl21-passage-augmented.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-passage-d2q-t5.md b/docs/regressions-dl21-passage-d2q-t5.md index 596e2cab02..931491ffcf 100644 --- a/docs/regressions-dl21-passage-d2q-t5.md +++ b/docs/regressions-dl21-passage-d2q-t5.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-passage-splade-pp-ed.md b/docs/regressions-dl21-passage-splade-pp-ed.md index a052d5e4ea..817f90971d 100644 --- a/docs/regressions-dl21-passage-splade-pp-ed.md +++ b/docs/regressions-dl21-passage-splade-pp-ed.md @@ -69,7 +69,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-passage-splade-pp-sd.md b/docs/regressions-dl21-passage-splade-pp-sd.md index ec54568c74..30c92add28 100644 --- a/docs/regressions-dl21-passage-splade-pp-sd.md +++ b/docs/regressions-dl21-passage-splade-pp-sd.md @@ -69,7 +69,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-passage-unicoil-0shot.md b/docs/regressions-dl21-passage-unicoil-0shot.md index b8536127ba..fa821c8e5d 100644 --- a/docs/regressions-dl21-passage-unicoil-0shot.md +++ b/docs/regressions-dl21-passage-unicoil-0shot.md @@ -78,7 +78,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-passage-unicoil-noexp-0shot.md b/docs/regressions-dl21-passage-unicoil-noexp-0shot.md index da50e76035..8e76a6ce4e 100644 --- a/docs/regressions-dl21-passage-unicoil-noexp-0shot.md +++ b/docs/regressions-dl21-passage-unicoil-noexp-0shot.md @@ -78,7 +78,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl21-passage.md b/docs/regressions-dl21-passage.md index fd44ddf000..e669d7c3b7 100644 --- a/docs/regressions-dl21-passage.md +++ b/docs/regressions-dl21-passage.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/docs/regressions-dl22-passage-augmented-d2q-t5.md b/docs/regressions-dl22-passage-augmented-d2q-t5.md index 24d532e9e2..a3ebbd5234 100644 --- a/docs/regressions-dl22-passage-augmented-d2q-t5.md +++ b/docs/regressions-dl22-passage-augmented-d2q-t5.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-dl22-passage-augmented.md b/docs/regressions-dl22-passage-augmented.md index bb9d5d5cab..0bf657dbb5 100644 --- a/docs/regressions-dl22-passage-augmented.md +++ b/docs/regressions-dl22-passage-augmented.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-dl22-passage-d2q-t5.md b/docs/regressions-dl22-passage-d2q-t5.md index 496cb7eda5..1a46bf4c52 100644 --- a/docs/regressions-dl22-passage-d2q-t5.md +++ b/docs/regressions-dl22-passage-d2q-t5.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-dl22-passage-splade-pp-ed.md b/docs/regressions-dl22-passage-splade-pp-ed.md index a5b6394c0d..d55bd078a0 100644 --- a/docs/regressions-dl22-passage-splade-pp-ed.md +++ b/docs/regressions-dl22-passage-splade-pp-ed.md @@ -69,7 +69,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-dl22-passage-splade-pp-sd.md b/docs/regressions-dl22-passage-splade-pp-sd.md index b1ae79fe5a..282d7adc37 100644 --- a/docs/regressions-dl22-passage-splade-pp-sd.md +++ b/docs/regressions-dl22-passage-splade-pp-sd.md @@ -69,7 +69,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-dl22-passage-unicoil-0shot.md b/docs/regressions-dl22-passage-unicoil-0shot.md index e31be6a02d..5cf7db9f65 100644 --- a/docs/regressions-dl22-passage-unicoil-0shot.md +++ b/docs/regressions-dl22-passage-unicoil-0shot.md @@ -78,7 +78,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-dl22-passage-unicoil-noexp-0shot.md b/docs/regressions-dl22-passage-unicoil-noexp-0shot.md index 78bcedffe1..ae77adb71b 100644 --- a/docs/regressions-dl22-passage-unicoil-noexp-0shot.md +++ b/docs/regressions-dl22-passage-unicoil-noexp-0shot.md @@ -78,7 +78,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-dl22-passage.md b/docs/regressions-dl22-passage.md index 29ba69aec1..fad36db80a 100644 --- a/docs/regressions-dl22-passage.md +++ b/docs/regressions-dl22-passage.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-fever.md b/docs/regressions-fever.md index 26bd107f88..c1abbad8f4 100644 --- a/docs/regressions-fever.md +++ b/docs/regressions-fever.md @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 9999 claims as part of the dev set for the original FEVER paper. The original data can be found [here](https://fever.ai/resources.html). diff --git a/docs/regressions-fire12-bn.md b/docs/regressions-fire12-bn.md index 99c86057b0..cafea8db93 100644 --- a/docs/regressions-fire12-bn.md +++ b/docs/regressions-fire12-bn.md @@ -33,10 +33,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): -+ [`topics.fire12bn.176-225.txt`](../tools/topics-and-qrels/topics.fire12bn.176-225.txt): topics for FIRE 2012 Monolingual Bengali (176 to 225) -+ [`qrels.fire12bn.176-225.txt`](../tools/topics-and-qrels/qrels.fire12bn.176-225.txt): qrels (version II) for FIRE 2012 Monolingual Bengali (176 to 225) ++ [`topics.fire12bn.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.fire12bn.176-225.txt): topics for FIRE 2012 Monolingual Bengali (176 to 225) ++ [`qrels.fire12bn.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.fire12bn.176-225.txt): qrels (version II) for FIRE 2012 Monolingual Bengali (176 to 225) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-fire12-en.md b/docs/regressions-fire12-en.md index f4dbbb6b27..cf32a7fe8b 100644 --- a/docs/regressions-fire12-en.md +++ b/docs/regressions-fire12-en.md @@ -33,10 +33,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): -+ [`topics.fire12en.176-225.txt`](../tools/topics-and-qrels/topics.fire12en.176-225.txt): topics for FIRE 2012 Monolingual English (176 to 225) -+ [`qrels.fire12en.176-225.txt`](../tools/topics-and-qrels/qrels.fire12en.176-225.txt): qrels (version II) for FIRE 2012 Monolingual English (176 to 225) ++ [`topics.fire12en.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.fire12en.176-225.txt): topics for FIRE 2012 Monolingual English (176 to 225) ++ [`qrels.fire12en.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.fire12en.176-225.txt): qrels (version II) for FIRE 2012 Monolingual English (176 to 225) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-fire12-hi.md b/docs/regressions-fire12-hi.md index 5d17bbcf73..7193fdf7e0 100644 --- a/docs/regressions-fire12-hi.md +++ b/docs/regressions-fire12-hi.md @@ -33,10 +33,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): -+ [`topics.fire12hi.176-225.txt`](../tools/topics-and-qrels/topics.fire12hi.176-225.txt): topics for FIRE 2012 Monolingual Hindi (176 to 225) -+ [`qrels.fire12hi.176-225.txt`](../tools/topics-and-qrels/qrels.fire12hi.176-225.txt): qrels (version II) for FIRE 2012 Monolingual Hindi (176 to 225) ++ [`topics.fire12hi.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.fire12hi.176-225.txt): topics for FIRE 2012 Monolingual Hindi (176 to 225) ++ [`qrels.fire12hi.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.fire12hi.176-225.txt): qrels (version II) for FIRE 2012 Monolingual Hindi (176 to 225) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-gov2.md b/docs/regressions-gov2.md index 30cb733ddd..b8a46cc776 100644 --- a/docs/regressions-gov2.md +++ b/docs/regressions-gov2.md @@ -32,14 +32,15 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: - -+ [`topics.terabyte04.701-750.txt`](../tools/topics-and-qrels/topics.terabyte04.701-750.txt): [topics for the TREC 2004 Terabyte Track (Topics 701-750)](http://trec.nist.gov/data/terabyte/04/04topics.701-750.txt) -+ [`topics.terabyte05.751-800.txt`](../tools/topics-and-qrels/topics.terabyte05.751-800.txt): [topics for the TREC 2005 Terabyte Track (Topics 751-800)](http://trec.nist.gov/data/terabyte/05/05.topics.751-800.txt) -+ [`topics.terabyte06.801-850.txt`](../tools/topics-and-qrels/topics.terabyte06.801-850.txt): [topics for the TREC 2006 Terabyte Track (Topics 801-850)](http://trec.nist.gov/data/terabyte/06/06.topics.801-850.txt) -+ [`qrels.terabyte04.701-750.txt`](../tools/topics-and-qrels/qrels.terabyte04.701-750.txt): [qrels for the TREC 2004 Terabyte Track (Topics 701-750)](http://trec.nist.gov/data/terabyte/04/04.qrels.12-Nov-04) -+ [`qrels.terabyte05.751-800.txt`](../tools/topics-and-qrels/qrels.terabyte05.751-800.txt): [qrels for the TREC 2005 Terabyte Track (Topics 751-800)](http://trec.nist.gov/data/terabyte/05/05.adhoc_qrels) -+ [`qrels.terabyte06.801-850.txt`](../tools/topics-and-qrels/qrels.terabyte06.801-850.txt): [qrels for the TREC 2006 Terabyte Track (Topics 801-850)](http://trec.nist.gov/data/terabyte/06/qrels.tb06.top50) +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: + ++ [`topics.terabyte04.701-750.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.terabyte04.701-750.txt): [topics for the TREC 2004 Terabyte Track (Topics 701-750)](http://trec.nist.gov/data/terabyte/04/04topics.701-750.txt) ++ [`topics.terabyte05.751-800.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.terabyte05.751-800.txt): [topics for the TREC 2005 Terabyte Track (Topics 751-800)](http://trec.nist.gov/data/terabyte/05/05.topics.751-800.txt) ++ [`topics.terabyte06.801-850.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.terabyte06.801-850.txt): [topics for the TREC 2006 Terabyte Track (Topics 801-850)](http://trec.nist.gov/data/terabyte/06/06.topics.801-850.txt) ++ [`qrels.terabyte04.701-750.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.terabyte04.701-750.txt): [qrels for the TREC 2004 Terabyte Track (Topics 701-750)](http://trec.nist.gov/data/terabyte/04/04.qrels.12-Nov-04) ++ [`qrels.terabyte05.751-800.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.terabyte05.751-800.txt): [qrels for the TREC 2005 Terabyte Track (Topics 751-800)](http://trec.nist.gov/data/terabyte/05/05.adhoc_qrels) ++ [`qrels.terabyte06.801-850.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.terabyte06.801-850.txt): [qrels for the TREC 2006 Terabyte Track (Topics 801-850)](http://trec.nist.gov/data/terabyte/06/qrels.tb06.top50) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-mb11.md b/docs/regressions-mb11.md index 4eda54491a..4693469017 100644 --- a/docs/regressions-mb11.md +++ b/docs/regressions-mb11.md @@ -40,12 +40,13 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.microblog2011.txt`](../tools/topics-and-qrels/topics.microblog2011.txt): [topics for the TREC 2011 Microblog Track](https://trec.nist.gov/data/microblog/11/topics.MB1-50.txt) -+ [`topics.microblog2012.txt`](../tools/topics-and-qrels/topics.microblog2012.txt): [topics for the TREC 2012 Microblog Track](https://trec.nist.gov/data/microblog/12/2012.topics.MB51-110.txt) -+ [`qrels.microblog2011.txt`](../tools/topics-and-qrels/qrels.microblog2011.txt): [qrels for TREC 2011 Microblog Track](https://trec.nist.gov/data/microblog/11/microblog11-qrels) -+ [`qrels.microblog2012.txt`](../tools/topics-and-qrels/qrels.microblog2012.txt): [qrels for TREC 2012 Microblog Track](https://trec.nist.gov/data/microblog/12/adhoc-qrels) ++ [`topics.microblog2011.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.microblog2011.txt): [topics for the TREC 2011 Microblog Track](https://trec.nist.gov/data/microblog/11/topics.MB1-50.txt) ++ [`topics.microblog2012.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.microblog2012.txt): [topics for the TREC 2012 Microblog Track](https://trec.nist.gov/data/microblog/12/2012.topics.MB51-110.txt) ++ [`qrels.microblog2011.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.microblog2011.txt): [qrels for TREC 2011 Microblog Track](https://trec.nist.gov/data/microblog/11/microblog11-qrels) ++ [`qrels.microblog2012.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.microblog2012.txt): [qrels for TREC 2012 Microblog Track](https://trec.nist.gov/data/microblog/12/adhoc-qrels) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-mb13.md b/docs/regressions-mb13.md index 83305e3258..f7cff8b332 100644 --- a/docs/regressions-mb13.md +++ b/docs/regressions-mb13.md @@ -40,12 +40,13 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.microblog2013.txt`](../tools/topics-and-qrels/topics.microblog2013.txt): [topics for the TREC 2013 Microblog Track](https://trec.nist.gov/data/microblog/2013/topics.MB111-170.txt) -+ [`topics.microblog2014.txt`](../tools/topics-and-qrels/topics.microblog2014.txt): [topics for the TREC 2014 Microblog Track](https://trec.nist.gov/data/microblog/2014/topics.MB171-225.txt) -+ [`qrels.microblog2013.txt`](../tools/topics-and-qrels/qrels.microblog2013.txt): [qrels for the TREC 2013 Microblog Track](https://trec.nist.gov/data/microblog/2013/qrels.txt) -+ [`qrels.microblog2014.txt`](../tools/topics-and-qrels/qrels.microblog2014.txt): [qrels for the TREC 2014 Microblog Track](https://trec.nist.gov/data/microblog/2014/qrels2014.txt) ++ [`topics.microblog2013.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.microblog2013.txt): [topics for the TREC 2013 Microblog Track](https://trec.nist.gov/data/microblog/2013/topics.MB111-170.txt) ++ [`topics.microblog2014.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.microblog2014.txt): [topics for the TREC 2014 Microblog Track](https://trec.nist.gov/data/microblog/2014/topics.MB171-225.txt) ++ [`qrels.microblog2013.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.microblog2013.txt): [qrels for the TREC 2013 Microblog Track](https://trec.nist.gov/data/microblog/2013/qrels.txt) ++ [`qrels.microblog2014.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.microblog2014.txt): [qrels for the TREC 2014 Microblog Track](https://trec.nist.gov/data/microblog/2014/qrels2014.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-doc-ca.md b/docs/regressions-msmarco-doc-ca.md index f5e8d94360..492da8b1a0 100644 --- a/docs/regressions-msmarco-doc-ca.md +++ b/docs/regressions-msmarco-doc-ca.md @@ -35,7 +35,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-doc-docTTTTTquery.md b/docs/regressions-msmarco-doc-docTTTTTquery.md index 9aa31d2d77..59d2b31457 100644 --- a/docs/regressions-msmarco-doc-docTTTTTquery.md +++ b/docs/regressions-msmarco-doc-docTTTTTquery.md @@ -44,7 +44,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-doc-hgf-wp.md b/docs/regressions-msmarco-doc-hgf-wp.md index bff52bb2b6..178227ce72 100644 --- a/docs/regressions-msmarco-doc-hgf-wp.md +++ b/docs/regressions-msmarco-doc-hgf-wp.md @@ -36,8 +36,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-doc-segmented-ca.md b/docs/regressions-msmarco-doc-segmented-ca.md index 965dad5cdd..29fe567aad 100644 --- a/docs/regressions-msmarco-doc-segmented-ca.md +++ b/docs/regressions-msmarco-doc-segmented-ca.md @@ -46,9 +46,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. -The original data can be found [here](https://trec.nist.gov/data/deep2020.html). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-doc-segmented-docTTTTTquery.md b/docs/regressions-msmarco-doc-segmented-docTTTTTquery.md index 601ff8d773..c687bfa7e8 100644 --- a/docs/regressions-msmarco-doc-segmented-docTTTTTquery.md +++ b/docs/regressions-msmarco-doc-segmented-docTTTTTquery.md @@ -45,7 +45,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-doc-segmented-unicoil-noexp.md b/docs/regressions-msmarco-doc-segmented-unicoil-noexp.md index b06382af7f..b9de71508d 100644 --- a/docs/regressions-msmarco-doc-segmented-unicoil-noexp.md +++ b/docs/regressions-msmarco-doc-segmented-unicoil-noexp.md @@ -71,8 +71,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-doc-segmented-unicoil.md b/docs/regressions-msmarco-doc-segmented-unicoil.md index ec7eb5a684..af1089fffa 100644 --- a/docs/regressions-msmarco-doc-segmented-unicoil.md +++ b/docs/regressions-msmarco-doc-segmented-unicoil.md @@ -71,8 +71,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-doc-segmented-wp.md b/docs/regressions-msmarco-doc-segmented-wp.md index 4d69332f9c..4258890e82 100644 --- a/docs/regressions-msmarco-doc-segmented-wp.md +++ b/docs/regressions-msmarco-doc-segmented-wp.md @@ -37,7 +37,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-doc-segmented.md b/docs/regressions-msmarco-doc-segmented.md index 66d41b58a1..32337d9035 100644 --- a/docs/regressions-msmarco-doc-segmented.md +++ b/docs/regressions-msmarco-doc-segmented.md @@ -45,7 +45,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-doc-wp.md b/docs/regressions-msmarco-doc-wp.md index fb8a8c7c06..5432fe80c6 100644 --- a/docs/regressions-msmarco-doc-wp.md +++ b/docs/regressions-msmarco-doc-wp.md @@ -36,7 +36,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-doc.md b/docs/regressions-msmarco-doc.md index afc51a9735..954b5f7b3e 100644 --- a/docs/regressions-msmarco-doc.md +++ b/docs/regressions-msmarco-doc.md @@ -44,7 +44,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-bm25-b8.md b/docs/regressions-msmarco-passage-bm25-b8.md index 34aef19d47..4af77f2e31 100644 --- a/docs/regressions-msmarco-passage-bm25-b8.md +++ b/docs/regressions-msmarco-passage-bm25-b8.md @@ -59,7 +59,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-ca.md b/docs/regressions-msmarco-passage-ca.md index 79ebff355a..8da43f7565 100644 --- a/docs/regressions-msmarco-passage-ca.md +++ b/docs/regressions-msmarco-passage-ca.md @@ -34,7 +34,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-deepimpact.md b/docs/regressions-msmarco-passage-deepimpact.md index 925b5e67a8..11fff02c59 100644 --- a/docs/regressions-msmarco-passage-deepimpact.md +++ b/docs/regressions-msmarco-passage-deepimpact.md @@ -66,7 +66,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-distill-splade-max.md b/docs/regressions-msmarco-passage-distill-splade-max.md index bcad8b3f0b..5c5839d976 100644 --- a/docs/regressions-msmarco-passage-distill-splade-max.md +++ b/docs/regressions-msmarco-passage-distill-splade-max.md @@ -67,7 +67,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-doc2query.md b/docs/regressions-msmarco-passage-doc2query.md index 6289696b7e..06960deb20 100644 --- a/docs/regressions-msmarco-passage-doc2query.md +++ b/docs/regressions-msmarco-passage-doc2query.md @@ -39,7 +39,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-docTTTTTquery.md b/docs/regressions-msmarco-passage-docTTTTTquery.md index e6767b94f0..6bd66d91ee 100644 --- a/docs/regressions-msmarco-passage-docTTTTTquery.md +++ b/docs/regressions-msmarco-passage-docTTTTTquery.md @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-hgf-wp.md b/docs/regressions-msmarco-passage-hgf-wp.md index e5b897631b..e3b40c832f 100644 --- a/docs/regressions-msmarco-passage-hgf-wp.md +++ b/docs/regressions-msmarco-passage-hgf-wp.md @@ -36,7 +36,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-splade-distil-cocodenser-medium.md b/docs/regressions-msmarco-passage-splade-distil-cocodenser-medium.md index 8b86c9e92f..de09847b80 100644 --- a/docs/regressions-msmarco-passage-splade-distil-cocodenser-medium.md +++ b/docs/regressions-msmarco-passage-splade-distil-cocodenser-medium.md @@ -65,7 +65,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-splade-pp-ed-onnx.md b/docs/regressions-msmarco-passage-splade-pp-ed-onnx.md index fd86f4d535..a5ff2e962f 100644 --- a/docs/regressions-msmarco-passage-splade-pp-ed-onnx.md +++ b/docs/regressions-msmarco-passage-splade-pp-ed-onnx.md @@ -67,7 +67,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-splade-pp-ed.md b/docs/regressions-msmarco-passage-splade-pp-ed.md index e0f8f60a08..b8c4f98daf 100644 --- a/docs/regressions-msmarco-passage-splade-pp-ed.md +++ b/docs/regressions-msmarco-passage-splade-pp-ed.md @@ -67,7 +67,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-splade-pp-sd-onnx.md b/docs/regressions-msmarco-passage-splade-pp-sd-onnx.md index 47513df234..dd513ab06b 100644 --- a/docs/regressions-msmarco-passage-splade-pp-sd-onnx.md +++ b/docs/regressions-msmarco-passage-splade-pp-sd-onnx.md @@ -67,7 +67,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-splade-pp-sd.md b/docs/regressions-msmarco-passage-splade-pp-sd.md index cb13fff661..7093fcb9fa 100644 --- a/docs/regressions-msmarco-passage-splade-pp-sd.md +++ b/docs/regressions-msmarco-passage-splade-pp-sd.md @@ -67,7 +67,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-unicoil-noexp.md b/docs/regressions-msmarco-passage-unicoil-noexp.md index 8ceea04670..df0cfcb5d7 100644 --- a/docs/regressions-msmarco-passage-unicoil-noexp.md +++ b/docs/regressions-msmarco-passage-unicoil-noexp.md @@ -70,7 +70,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-unicoil-tilde-expansion.md b/docs/regressions-msmarco-passage-unicoil-tilde-expansion.md index 1602319476..298fa3e22c 100644 --- a/docs/regressions-msmarco-passage-unicoil-tilde-expansion.md +++ b/docs/regressions-msmarco-passage-unicoil-tilde-expansion.md @@ -67,7 +67,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-unicoil.md b/docs/regressions-msmarco-passage-unicoil.md index baae7c29dc..1426b5982b 100644 --- a/docs/regressions-msmarco-passage-unicoil.md +++ b/docs/regressions-msmarco-passage-unicoil.md @@ -67,7 +67,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage-wp.md b/docs/regressions-msmarco-passage-wp.md index 49606988f7..f2040a2903 100644 --- a/docs/regressions-msmarco-passage-wp.md +++ b/docs/regressions-msmarco-passage-wp.md @@ -35,7 +35,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-passage.md b/docs/regressions-msmarco-passage.md index b8674337ed..cd52851103 100644 --- a/docs/regressions-msmarco-passage.md +++ b/docs/regressions-msmarco-passage.md @@ -35,7 +35,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-doc-d2q-t5.md b/docs/regressions-msmarco-v2-doc-d2q-t5.md index f7a669ecaf..0f173a9e5e 100644 --- a/docs/regressions-msmarco-v2-doc-d2q-t5.md +++ b/docs/regressions-msmarco-v2-doc-d2q-t5.md @@ -35,8 +35,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-doc-segmented-d2q-t5.md b/docs/regressions-msmarco-v2-doc-segmented-d2q-t5.md index b8e4f13000..32d4105339 100644 --- a/docs/regressions-msmarco-v2-doc-segmented-d2q-t5.md +++ b/docs/regressions-msmarco-v2-doc-segmented-d2q-t5.md @@ -35,8 +35,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-doc-segmented-unicoil-0shot-v2.md b/docs/regressions-msmarco-v2-doc-segmented-unicoil-0shot-v2.md index b17bc4d860..c95696943b 100644 --- a/docs/regressions-msmarco-v2-doc-segmented-unicoil-0shot-v2.md +++ b/docs/regressions-msmarco-v2-doc-segmented-unicoil-0shot-v2.md @@ -81,8 +81,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-doc-segmented-unicoil-0shot.md b/docs/regressions-msmarco-v2-doc-segmented-unicoil-0shot.md index 4fbeff8b70..f452c417ae 100644 --- a/docs/regressions-msmarco-v2-doc-segmented-unicoil-0shot.md +++ b/docs/regressions-msmarco-v2-doc-segmented-unicoil-0shot.md @@ -80,8 +80,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-doc-segmented-unicoil-noexp-0shot-v2.md b/docs/regressions-msmarco-v2-doc-segmented-unicoil-noexp-0shot-v2.md index d199607788..bfade983a4 100644 --- a/docs/regressions-msmarco-v2-doc-segmented-unicoil-noexp-0shot-v2.md +++ b/docs/regressions-msmarco-v2-doc-segmented-unicoil-noexp-0shot-v2.md @@ -81,8 +81,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-doc-segmented-unicoil-noexp-0shot.md b/docs/regressions-msmarco-v2-doc-segmented-unicoil-noexp-0shot.md index f7df2f4805..283946c05d 100644 --- a/docs/regressions-msmarco-v2-doc-segmented-unicoil-noexp-0shot.md +++ b/docs/regressions-msmarco-v2-doc-segmented-unicoil-noexp-0shot.md @@ -80,8 +80,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-doc-segmented.md b/docs/regressions-msmarco-v2-doc-segmented.md index a8a846ae8a..6f1215471d 100644 --- a/docs/regressions-msmarco-v2-doc-segmented.md +++ b/docs/regressions-msmarco-v2-doc-segmented.md @@ -36,8 +36,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-doc.md b/docs/regressions-msmarco-v2-doc.md index 954ba35c20..d27e21b683 100644 --- a/docs/regressions-msmarco-v2-doc.md +++ b/docs/regressions-msmarco-v2-doc.md @@ -36,8 +36,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-passage-augmented-d2q-t5.md b/docs/regressions-msmarco-v2-passage-augmented-d2q-t5.md index 723d590c4c..14a744f4ca 100644 --- a/docs/regressions-msmarco-v2-passage-augmented-d2q-t5.md +++ b/docs/regressions-msmarco-v2-passage-augmented-d2q-t5.md @@ -34,8 +34,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-passage-augmented.md b/docs/regressions-msmarco-v2-passage-augmented.md index c7b7134898..4298abc87f 100644 --- a/docs/regressions-msmarco-v2-passage-augmented.md +++ b/docs/regressions-msmarco-v2-passage-augmented.md @@ -36,8 +36,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-passage-d2q-t5.md b/docs/regressions-msmarco-v2-passage-d2q-t5.md index 89c767e99b..5fa46ae857 100644 --- a/docs/regressions-msmarco-v2-passage-d2q-t5.md +++ b/docs/regressions-msmarco-v2-passage-d2q-t5.md @@ -34,8 +34,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-passage-splade-pp-ed.md b/docs/regressions-msmarco-v2-passage-splade-pp-ed.md index 2ac7cc1cca..2ec4343786 100644 --- a/docs/regressions-msmarco-v2-passage-splade-pp-ed.md +++ b/docs/regressions-msmarco-v2-passage-splade-pp-ed.md @@ -68,8 +68,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-passage-splade-pp-sd.md b/docs/regressions-msmarco-v2-passage-splade-pp-sd.md index 51ebb79862..ccaf8e687b 100644 --- a/docs/regressions-msmarco-v2-passage-splade-pp-sd.md +++ b/docs/regressions-msmarco-v2-passage-splade-pp-sd.md @@ -68,8 +68,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-passage-unicoil-0shot.md b/docs/regressions-msmarco-v2-passage-unicoil-0shot.md index 6e0a74beca..6cca015fc2 100644 --- a/docs/regressions-msmarco-v2-passage-unicoil-0shot.md +++ b/docs/regressions-msmarco-v2-passage-unicoil-0shot.md @@ -75,8 +75,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-passage-unicoil-noexp-0shot.md b/docs/regressions-msmarco-v2-passage-unicoil-noexp-0shot.md index 00adbd91e7..7edc61a228 100644 --- a/docs/regressions-msmarco-v2-passage-unicoil-noexp-0shot.md +++ b/docs/regressions-msmarco-v2-passage-unicoil-noexp-0shot.md @@ -75,8 +75,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-msmarco-v2-passage.md b/docs/regressions-msmarco-v2-passage.md index f629879952..0f6e91e4bf 100644 --- a/docs/regressions-msmarco-v2-passage.md +++ b/docs/regressions-msmarco-v2-passage.md @@ -36,8 +36,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-ntcir8-zh.md b/docs/regressions-ntcir8-zh.md index b8da6b77e6..595a058cb9 100644 --- a/docs/regressions-ntcir8-zh.md +++ b/docs/regressions-ntcir8-zh.md @@ -35,10 +35,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from the [NTCIR Test Collection page](https://www.nii.ac.jp/dsc/idr/en/ntcir/ntcir.html): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from the [NTCIR Test Collection page](https://www.nii.ac.jp/dsc/idr/en/ntcir/ntcir.html): -+ [`topics.ntcir8zh.eval.txt`](../tools/topics-and-qrels/topics.ntcir8zh.eval.txt): NTCIR-8 ACLIA (IR4QA subtask), monolingual Chinese topics -+ [`qrels.ntcir8.eval.txt `](../tools/topics-and-qrels/qrels.ntcir8.eval.txt): NTCIR-8 ACLIA (IR4QA subtask) relevance judgments ++ [`topics.ntcir8zh.eval.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.ntcir8zh.eval.txt): NTCIR-8 ACLIA (IR4QA subtask), monolingual Chinese topics ++ [`qrels.ntcir8.eval.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.ntcir8.eval.txt): NTCIR-8 ACLIA (IR4QA subtask) relevance judgments After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-robust05.md b/docs/regressions-robust05.md index 62755aac60..86473a38dd 100644 --- a/docs/regressions-robust05.md +++ b/docs/regressions-robust05.md @@ -32,10 +32,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.robust05.txt`](../tools/topics-and-qrels/topics.robust05.txt): [topics for the TREC 2005 Robust Track (Hard Topics of Robust04)](http://trec.nist.gov/data/robust/05/05.50.topics.txt) -+ [`qrels.robust05.txt`](../tools/topics-and-qrels/qrels.robust05.txt): [qrels for the TREC 2005 Robust Track (Hard Topics of Robust04)](http://trec.nist.gov/data/robust/05/TREC2005.qrels.txt) ++ [`topics.robust05.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.robust05.txt): [topics for the TREC 2005 Robust Track (Hard Topics of Robust04)](http://trec.nist.gov/data/robust/05/05.50.topics.txt) ++ [`qrels.robust05.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.robust05.txt): [qrels for the TREC 2005 Robust Track (Hard Topics of Robust04)](http://trec.nist.gov/data/robust/05/TREC2005.qrels.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-trec02-ar.md b/docs/regressions-trec02-ar.md index 0b10e2e1c7..1d46111150 100644 --- a/docs/regressions-trec02-ar.md +++ b/docs/regressions-trec02-ar.md @@ -35,10 +35,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST's page for [non-English topics](https://trec.nist.gov/data/topics_noneng/index.html) and [non-English relevance judgments](https://trec.nist.gov/data/qrels_noneng/index.html): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST's page for [non-English topics](https://trec.nist.gov/data/topics_noneng/index.html) and [non-English relevance judgments](https://trec.nist.gov/data/qrels_noneng/index.html): -+ [`topics.trec02ar-ar.txt`](../tools/topics-and-qrels/topics.trec02ar-ar.txt): TREC 2002 cross language topics in Arabic -+ [`qrels.trec02ar.txt`](../tools/topics-and-qrels/qrels.trec02ar.txt): TREC 2002 cross language relevance judgements ++ [`topics.trec02ar-ar.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.trec02ar-ar.txt): TREC 2002 cross language topics in Arabic ++ [`qrels.trec02ar.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.trec02ar.txt): TREC 2002 cross language relevance judgements After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-wiki-all-6-3-tamber-bm25.md b/docs/regressions-wiki-all-6-3-tamber-bm25.md index 767daa6eef..8c74b96439 100644 --- a/docs/regressions-wiki-all-6-3-tamber-bm25.md +++ b/docs/regressions-wiki-all-6-3-tamber-bm25.md @@ -1,8 +1,11 @@ -# Anserini Regressions: QA with wiki-all-6-3-tamber Corpus +# Anserini Regressions: QA on Wikipedia Sliding Windows **Models**: BM25 -This page documents QA regression experiments on the wiki-all-6-3-tamber corpus, which is integrated into Anserini's regression testing framework. +This page documents QA regression experiments on the `wiki-all-6-3-tamber` corpus, which is integrated into Anserini's regression testing framework. +The exact configuration here is the 6/3 sentence sliding window corpus described in the following paper: + +> Manveer Singh Tamber, Ronak Pradeep, and Jimmy Lin. [Pre-Processing Matters! Improved Wikipedia Corpora for Open-Domain Question Answering.](https://link.springer.com/chapter/10.1007/978-3-031-28241-6_11) _Proceedings of the 45th European Conference on Information Retrieval (ECIR 2023), Part III_, pages 163–176, April 2023, Dublin, Ireland. The exact configurations for these regressions are stored in [this YAML file](../src/main/resources/regression/wiki-all-6-3-tamber-bm25.yaml). Note that this page is automatically generated from [this template](../src/main/resources/docgen/templates/wiki-all-6-3-tamber-bm25.template) as part of Anserini's regression pipeline, so do not modify this page directly; modify the template instead. @@ -33,8 +36,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set of multiple QA datasets, namely Natural Questions, TriviaQA, SQuAD, and WebQuestions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the test sets of Natural Questions, TriviaQA, SQuAD, and WebQuestions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-wikipedia-dpr-100w-bm25.md b/docs/regressions-wikipedia-dpr-100w-bm25.md index b5d9c84fbd..56533bb76b 100644 --- a/docs/regressions-wikipedia-dpr-100w-bm25.md +++ b/docs/regressions-wikipedia-dpr-100w-bm25.md @@ -1,8 +1,8 @@ -# Anserini Regressions: QA with wikipedia-dpr-100w Corpus +# Anserini Regressions: QA on Wikipedia 100-word splits **Models**: BM25 -This page documents QA regression experiments on the wikipedia-dpr-100w corpus, which is integrated into Anserini's regression testing framework. +This page documents QA regression experiments on the `wikipedia-dpr-100w` corpus, which is integrated into Anserini's regression testing framework. The exact configurations for these regressions are stored in [this YAML file](../src/main/resources/regression/wikipedia-dpr-100w-bm25.yaml). Note that this page is automatically generated from [this template](../src/main/resources/docgen/templates/wikipedia-dpr-100w-bm25.template) as part of Anserini's regression pipeline, so do not modify this page directly; modify the template instead. @@ -33,8 +33,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set of multiple QA datasets, namely Natural Questions, TriviaQA, SQuAD, and WebQuestions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the test sets of Natural Questions, TriviaQA, SQuAD, and WebQuestions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/docs/regressions-wt10g.md b/docs/regressions-wt10g.md index b2fa0fafa2..917294f8dd 100644 --- a/docs/regressions-wt10g.md +++ b/docs/regressions-wt10g.md @@ -32,10 +32,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.adhoc.451-550.txt`](../tools/topics-and-qrels/topics.adhoc.451-550.txt): topics for the [TREC-9 Web Track](http://trec.nist.gov/data/topics_eng/topics.451-500.gz) and the [TREC 2001 Web Track](http://trec.nist.gov/data/topics_eng/topics.501-550.txt) -+ [`qrels.adhoc.451-550.txt`](../tools/topics-and-qrels/qrels.adhoc.451-550.txt): qrels for the [TREC-9 Web Track](http://trec.nist.gov/data/qrels_eng/qrels.trec9.main_web.gz) and the [TREC 2001 Web Track](http://trec.nist.gov/data/qrels_eng/adhoc_qrels.txt) ++ [`topics.adhoc.451-550.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.451-550.txt): topics for the [TREC-9 Web Track](http://trec.nist.gov/data/topics_eng/topics.451-500.gz) and the [TREC 2001 Web Track](http://trec.nist.gov/data/topics_eng/topics.501-550.txt) ++ [`qrels.adhoc.451-550.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.451-550.txt): qrels for the [TREC-9 Web Track](http://trec.nist.gov/data/qrels_eng/qrels.trec9.main_web.gz) and the [TREC 2001 Web Track](http://trec.nist.gov/data/qrels_eng/adhoc_qrels.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/backgroundlinking18.template b/src/main/resources/docgen/templates/backgroundlinking18.template index fe16d30524..d58f681fe5 100644 --- a/src/main/resources/docgen/templates/backgroundlinking18.template +++ b/src/main/resources/docgen/templates/backgroundlinking18.template @@ -1,4 +1,4 @@ -# Anserini Regressions: TREC 2018 News Track (Background Linking) +# Anserini Regressions: TREC 2018 News Background Linking **Models**: various bag-of-words approaches @@ -27,10 +27,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.backgroundlinking18.txt`](../tools/topics-and-qrels/topics.backgroundlinking18.txt): [topics for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/newsir18-topics.txt) -+ [`qrels.backgroundlinking18.txt`](../tools/topics-and-qrels/qrels.backgroundlinking18.txt): [qrels for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/bqrels.exp-gains.txt) ++ [`topics.backgroundlinking18.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking18.txt): [topics for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/newsir18-topics.txt) ++ [`qrels.backgroundlinking18.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.backgroundlinking18.txt): [qrels for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/bqrels.exp-gains.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/backgroundlinking19.template b/src/main/resources/docgen/templates/backgroundlinking19.template index 4c14357ec1..d5e10b6b2b 100644 --- a/src/main/resources/docgen/templates/backgroundlinking19.template +++ b/src/main/resources/docgen/templates/backgroundlinking19.template @@ -1,4 +1,4 @@ -# Anserini Regressions: TREC 2019 News Track (Background Linking) +# Anserini Regressions: TREC 2019 News Background Linking **Models**: various bag-of-words approaches @@ -27,10 +27,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.backgroundlinking19.txt`](../tools/topics-and-qrels/topics.backgroundlinking19.txt): topics for the background linking task of the TREC 2019 News Track -+ [`qrels.backgroundlinking19.txt`](../tools/topics-and-qrels/qrels.backgroundlinking19.txt): qrels for the background linking task of the TREC 2019 News Track ++ [`topics.backgroundlinking19.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking19.txt): topics for the background linking task of the TREC 2019 News Track ++ [`qrels.backgroundlinking19.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.backgroundlinking19.txt): qrels for the background linking task of the TREC 2019 News Track After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/backgroundlinking20.template b/src/main/resources/docgen/templates/backgroundlinking20.template index c6af3067c1..9d223b80b6 100644 --- a/src/main/resources/docgen/templates/backgroundlinking20.template +++ b/src/main/resources/docgen/templates/backgroundlinking20.template @@ -1,4 +1,4 @@ -# Anserini Regressions: TREC 2020 News Track (Background Linking) +# Anserini Regressions: TREC 2020 News Background Linking **Models**: various bag-of-words approaches @@ -27,10 +27,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.backgroundlinking20.txt`](../tools/topics-and-qrels/topics.backgroundlinking20.txt): topics for the background linking task of the TREC 2020 News Track -+ [`qrels.backgroundlinking20.txt`](../tools/topics-and-qrels/qrels.backgroundlinking20.txt): qrels for the background linking task of the TREC 2020 News Track ++ [`topics.backgroundlinking20.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking20.txt): topics for the background linking task of the TREC 2020 News Track ++ [`qrels.backgroundlinking20.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.backgroundlinking20.txt): qrels for the background linking task of the TREC 2020 News Track After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-arguana-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-arguana-flat-wp.template index 2b1483f2f4..d713a10f1a 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-arguana-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-arguana-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-arguana-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-arguana-flat.template index 1d1311cbf9..30f24a9279 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-arguana-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-arguana-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-arguana-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-arguana-multifield.template index db59c13677..438360ed85 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-arguana-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-arguana-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-arguana-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-arguana-splade-distil-cocodenser-medium.template index 7c5debe149..d7366de0df 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-arguana-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-arguana-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-arguana-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-arguana-unicoil-noexp.template index 9651afcf51..e98b150125 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-arguana-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-arguana-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-flat-wp.template index 681dbd55da..7de3834403 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-flat.template index ebe65f8c36..a41769a73c 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-multifield.template index 911f2412b6..715e3b18f3 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-splade-distil-cocodenser-medium.template index 7d47f9dd04..d8f226e613 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-unicoil-noexp.template index f50197b078..6247033676 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-bioasq-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-flat-wp.template index a53e67f7ba..5dfc3e59cb 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-flat.template index 7434903260..2c94e552ef 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-multifield.template index 4556f07c48..5685e66426 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-splade-distil-cocodenser-medium.template index 2d804132fd..5600da8202 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-unicoil-noexp.template index cc98a24c88..e1d2923ebc 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-climate-fever-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-flat-wp.template index b1c6e68ea6..0b14d3d472 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-flat.template index 5260e14d2b..c0abcf0d14 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-multifield.template index 310670bb10..2ea2564808 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-splade-distil-cocodenser-medium.template index 3dc99e1514..8505e8373f 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-unicoil-noexp.template index 95d1728eb4..d4d7be04e6 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-android-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-flat-wp.template index f3880ef499..51cddee3b3 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-flat.template index 823ff8b052..91430df497 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-multifield.template index 308c9565bf..6b4acba975 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-splade-distil-cocodenser-medium.template index ee4253606a..d5600c2190 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-unicoil-noexp.template index 6978a0e0d0..a231b80726 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-english-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-flat-wp.template index db7920a5ca..f3b078974e 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-flat.template index 77c661b3c9..73e44f194e 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-multifield.template index f492333f3d..3e626d9a72 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-splade-distil-cocodenser-medium.template index 6e43f1af1c..738df5c7fd 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-unicoil-noexp.template index 45cdfd0e26..83fcc135cf 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gaming-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-flat-wp.template index c4cb0da3b5..b2b3d585f8 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-flat.template index 5c7ee173da..9f65da8dbe 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-multifield.template index 8c4b1e955e..6352c2d352 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-splade-distil-cocodenser-medium.template index 6e4be05d75..e9f7e19d14 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-unicoil-noexp.template index 19efb161e4..7f9ecd4bcf 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-gis-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-flat-wp.template index d714c02176..72fb7a53ce 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-flat.template index 8d9d5a2849..cb1f1afcef 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-multifield.template index 2a43eaedc9..ebd0e3756e 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-splade-distil-cocodenser-medium.template index d40104c28f..9a3f2d579b 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-unicoil-noexp.template index 344e32aa09..f7f8ce5d59 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-mathematica-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-flat-wp.template index 134f6c6192..4b1e34d89c 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-flat.template index 1cd7cae9fb..41e4214176 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-multifield.template index d9a405bc7c..417b04c3ef 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-splade-distil-cocodenser-medium.template index d862ed1a1b..7aaa5ad799 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-unicoil-noexp.template index cbf693def6..44a3648366 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-physics-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-flat-wp.template index be07a2c61e..e211a90513 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-flat.template index 95128932dc..94c8d39721 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-multifield.template index 1ccfacb1c2..ccaf0a726b 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-splade-distil-cocodenser-medium.template index 4ab05eb616..9fef2b61c3 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-unicoil-noexp.template index 1c8353e058..858bf7cab4 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-programmers-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-flat-wp.template index c3d14d19d0..2758b6dc65 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-flat.template index 61e4b41512..5608c400b6 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-multifield.template index 7887a558f2..371240d231 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-splade-distil-cocodenser-medium.template index 06e4644a99..b7fbadf47a 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-unicoil-noexp.template index 870a1d1d1e..11dd5cd2e1 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-stats-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-flat-wp.template index 0b04d5c7ce..15428584a5 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-flat.template index 1e34ae9862..a6ebec95ed 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-multifield.template index 8bd0fb1f0e..8175f2948e 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-splade-distil-cocodenser-medium.template index 248a701580..b80e96d492 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-unicoil-noexp.template index b8efc97904..f45991369d 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-tex-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-flat-wp.template index 45278a0ad6..ce025e8a62 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-flat.template index 5e14a7deef..76256b355d 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-multifield.template index b07a6c8e54..36497b2794 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-splade-distil-cocodenser-medium.template index 5f4aa8dc67..f6b4b67736 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-unicoil-noexp.template index 4b8fe24b3c..81febbd917 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-unix-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-flat-wp.template index 326f6a5834..67bcc38d4a 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-flat.template index f4eecf4206..2058501390 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-multifield.template index 906bcca2c0..47ad9d9284 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-splade-distil-cocodenser-medium.template index 520ac98675..f20d12d26e 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-unicoil-noexp.template index 0714f2b8ce..619bfa1b24 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-webmasters-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-flat-wp.template index a975d3ac1c..63145335e1 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-flat.template index b8a78e3da3..43a4bc9623 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-multifield.template index 5f055361fc..2dff1137a1 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-splade-distil-cocodenser-medium.template index 219ff58d43..ff8c88bbe0 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-unicoil-noexp.template index f91a57fa0f..89c277eb4d 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-cqadupstack-wordpress-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-flat-wp.template index 62355e461b..b13b5e8802 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-flat.template index c383ea6ca6..9c2a80d06a 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-multifield.template index abf5b50a3c..eac52addc4 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-splade-distil-cocodenser-medium.template index d5851f50d4..60b8a66cd9 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-unicoil-noexp.template index e2c60ebde9..f164ecebec 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-dbpedia-entity-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-fever-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-fever-flat-wp.template index b921ce4043..6e5c17d97d 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-fever-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-fever-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-fever-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-fever-flat.template index 0292a02162..177f228ce9 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-fever-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-fever-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-fever-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-fever-multifield.template index 68b1fb8b4e..629c36ed64 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-fever-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-fever-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-fever-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-fever-splade-distil-cocodenser-medium.template index f8fd4fe877..162abfeae2 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-fever-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-fever-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-fever-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-fever-unicoil-noexp.template index e83974c984..8263ea8af7 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-fever-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-fever-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-flat-wp.template index c4c3c7e8d3..acf3e05ca4 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-flat.template index 63f2ac2cfd..95deb6222f 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-multifield.template index eee370059d..2f95ee3bf0 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-splade-distil-cocodenser-medium.template index 92db2d872f..bbf5415f5b 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-unicoil-noexp.template index 55c37a7021..c4bb2ae241 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-fiqa-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-flat-wp.template index 392e7c282f..41e1f4d69e 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-flat.template index 3a4f178e2d..243b8e110c 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-multifield.template index 8ad8565e70..06800e244f 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-splade-distil-cocodenser-medium.template index 45edb2fcb4..540e80b872 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-unicoil-noexp.template index 52b85e4257..16a3451ac8 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-hotpotqa-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-flat-wp.template index 571ca1ed46..54af9971bf 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-flat.template index 171dd0ccda..70f22e7cfe 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-multifield.template index 5733646441..274cc36c19 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-splade-distil-cocodenser-medium.template index 9e463240a5..8a8298d11b 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-unicoil-noexp.template index 6073da2196..d6bd57b121 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-nfcorpus-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-nq-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-nq-flat-wp.template index 96d2de5b7e..f06a9f629a 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-nq-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-nq-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-nq-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-nq-flat.template index 47cda9ff98..72c930d330 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-nq-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-nq-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-nq-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-nq-multifield.template index 2f38d92539..c9d9403fa6 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-nq-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-nq-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-nq-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-nq-splade-distil-cocodenser-medium.template index 814e23db38..3d1466aae1 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-nq-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-nq-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-nq-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-nq-unicoil-noexp.template index b9cb40e293..a47343d65f 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-nq-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-nq-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-quora-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-quora-flat-wp.template index 9764aeeef6..d94a37d6af 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-quora-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-quora-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-quora-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-quora-flat.template index ecc5831592..90a9a9c69c 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-quora-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-quora-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-quora-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-quora-multifield.template index 8324c6930d..03e4e961f6 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-quora-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-quora-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-quora-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-quora-splade-distil-cocodenser-medium.template index d2b12ed79d..88565e8c02 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-quora-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-quora-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-quora-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-quora-unicoil-noexp.template index 22fbfe2ef3..7387a003b6 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-quora-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-quora-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-robust04-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-robust04-flat-wp.template index 6e39e8daf6..853eb43b62 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-robust04-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-robust04-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-robust04-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-robust04-flat.template index 189a3b973a..8ab4b276f3 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-robust04-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-robust04-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-robust04-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-robust04-multifield.template index 75b734e98a..edc5eb011e 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-robust04-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-robust04-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-robust04-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-robust04-splade-distil-cocodenser-medium.template index 2a771dc747..fdd4c58fce 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-robust04-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-robust04-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-robust04-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-robust04-unicoil-noexp.template index 25867fb870..02b54def24 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-robust04-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-robust04-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-flat-wp.template index e9fe4785bf..5fe68c98c5 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-flat.template index 8318852870..7530c66dff 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-multifield.template index 6e113db058..0a48b9d7f7 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-splade-distil-cocodenser-medium.template index 189dde9b26..e7370a0500 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-unicoil-noexp.template index 78d6b678be..bbbaf85776 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-scidocs-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-scifact-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-scifact-flat-wp.template index c01cf3017c..701bbc0150 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-scifact-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-scifact-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-scifact-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-scifact-flat.template index 8a8806fe5f..665d5ef882 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-scifact-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-scifact-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-scifact-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-scifact-multifield.template index 060f57bfe7..a1c2504918 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-scifact-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-scifact-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-scifact-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-scifact-splade-distil-cocodenser-medium.template index 5fe647b3d8..cfb4c3d0f6 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-scifact-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-scifact-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-scifact-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-scifact-unicoil-noexp.template index 978c932d08..50957734ee 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-scifact-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-scifact-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-flat-wp.template index d91da26c3e..3ccfc3733c 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-flat.template index 3e571ec010..a003535e43 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-multifield.template index a5d793a25f..85413f0758 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-splade-distil-cocodenser-medium.template index 93c0df80d8..09129a1c78 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-unicoil-noexp.template index 3e4813a142..6d8f8662a2 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-signal1m-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-flat-wp.template index 06d13da188..2e69bb5f4b 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-flat.template index 1579befe4e..e6e43e051a 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-multifield.template index 6ae4d4cff3..b8bfd68181 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-splade-distil-cocodenser-medium.template index 2d46d5c0bf..106073e8d2 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-unicoil-noexp.template index 38a8b75e66..c401c77e79 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-trec-covid-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-flat-wp.template index c1ff0c7308..5d80f9e54a 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-flat.template index 641acfe5aa..6a19dcaf34 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-multifield.template index 002ccc4e75..ee4188e807 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-splade-distil-cocodenser-medium.template index 437dd4637f..4888b659f4 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-unicoil-noexp.template index f38c118e24..b361db6d63 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-trec-news-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-flat-wp.template b/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-flat-wp.template index 036332b46e..07c8c54450 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-flat-wp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-flat-wp.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-flat.template b/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-flat.template index d1b5cffde2..5c36b439eb 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-flat.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-flat.template @@ -24,6 +24,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-multifield.template b/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-multifield.template index 671f458138..5e0b93b684 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-multifield.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-multifield.template @@ -25,6 +25,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-splade-distil-cocodenser-medium.template index e5228250d3..7c271103bc 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-splade-distil-cocodenser-medium.template @@ -57,8 +57,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set questions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-unicoil-noexp.template b/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-unicoil-noexp.template index f12ae93549..8b6cb165e9 100644 --- a/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/beir-v1.0.0-webis-touche2020-unicoil-noexp.template @@ -28,6 +28,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. + After indexing has completed, you should be able to perform retrieval as follows: ``` diff --git a/src/main/resources/docgen/templates/car17v1.5.template b/src/main/resources/docgen/templates/car17v1.5.template index 353790df44..00f3a2e82a 100644 --- a/src/main/resources/docgen/templates/car17v1.5.template +++ b/src/main/resources/docgen/templates/car17v1.5.template @@ -26,10 +26,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -The "benchmarkY1-test" topics and qrels (v1.5) are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): +The "benchmarkY1-test" topics and qrels (v1.5) are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): -+ [`topics.car17v1.5.benchmarkY1test.txt`](../tools/topics-and-qrels/topics.car17v1.5.benchmarkY1test.txt) -+ [`qrels.car17v1.5.benchmarkY1test.txt`](../tools/topics-and-qrels/qrels.car17v1.5.benchmarkY1test.txt) ++ [`topics.car17v1.5.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.car17v1.5.benchmarkY1test.txt) ++ [`qrels.car17v1.5.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.car17v1.5.benchmarkY1test.txt) Specifically, this is the section-level passage retrieval task with automatic ground truth. diff --git a/src/main/resources/docgen/templates/car17v2.0-doc2query.template b/src/main/resources/docgen/templates/car17v2.0-doc2query.template index f62c02674f..fe8ecea956 100644 --- a/src/main/resources/docgen/templates/car17v2.0-doc2query.template +++ b/src/main/resources/docgen/templates/car17v2.0-doc2query.template @@ -32,10 +32,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -The "benchmarkY1-test" topics and qrels (v2.0) are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): +The "benchmarkY1-test" topics and qrels (v2.0) are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): -+ [`topics.car17v2.0.benchmarkY1test.txt`](../tools/topics-and-qrels/topics.car17v2.0.benchmarkY1test.txt) -+ [`qrels.car17v2.0.benchmarkY1test.txt`](../tools/topics-and-qrels/qrels.car17v2.0.benchmarkY1test.txt) ++ [`topics.car17v2.0.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.car17v2.0.benchmarkY1test.txt) ++ [`qrels.car17v2.0.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.car17v2.0.benchmarkY1test.txt) Specifically, this is the section-level passage retrieval task with automatic ground truth. diff --git a/src/main/resources/docgen/templates/car17v2.0.template b/src/main/resources/docgen/templates/car17v2.0.template index 6505d6f6a0..48a821dfd5 100644 --- a/src/main/resources/docgen/templates/car17v2.0.template +++ b/src/main/resources/docgen/templates/car17v2.0.template @@ -26,10 +26,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -The "benchmarkY1-test" topics and qrels (v2.0) are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): +The "benchmarkY1-test" topics and qrels (v2.0) are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from [the CAR website](http://trec-car.cs.unh.edu/datareleases/): -+ [`topics.car17v2.0.benchmarkY1test.txt`](../tools/topics-and-qrels/topics.car17v2.0.benchmarkY1test.txt) -+ [`qrels.car17v2.0.benchmarkY1test.txt`](../tools/topics-and-qrels/qrels.car17v2.0.benchmarkY1test.txt) ++ [`topics.car17v2.0.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.car17v2.0.benchmarkY1test.txt) ++ [`qrels.car17v2.0.benchmarkY1test.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.car17v2.0.benchmarkY1test.txt) Specifically, this is the section-level passage retrieval task with automatic ground truth. diff --git a/src/main/resources/docgen/templates/clef06-fr.template b/src/main/resources/docgen/templates/clef06-fr.template index 9920dc6f71..32ee51ca1a 100644 --- a/src/main/resources/docgen/templates/clef06-fr.template +++ b/src/main/resources/docgen/templates/clef06-fr.template @@ -28,10 +28,10 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), from the [CLEF test suites pages](http://www.clef-initiative.eu/dataset/corpus): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. -+ [`topics.clef06fr.mono.fr.txt`](../tools/topics-and-qrels/topics.clef06fr.mono.fr.txt): CLEF 2006 ad hoc track topics in French -+ [`qrels.clef06fr.txt`](../tools/topics-and-qrels/qrels.clef06fr.txt): CLEF 2006 ad hoc track French relevance judgements ++ [`topics.clef06fr.mono.fr.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.clef06fr.mono.fr.txt): CLEF 2006 ad hoc track topics in French ++ [`qrels.clef06fr.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.clef06fr.txt): CLEF 2006 ad hoc track French relevance judgements After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/core17.template b/src/main/resources/docgen/templates/core17.template index 6a30a30e94..d4fe88da50 100644 --- a/src/main/resources/docgen/templates/core17.template +++ b/src/main/resources/docgen/templates/core17.template @@ -27,10 +27,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.core17.txt`](../tools/topics-and-qrels/topics.core17.txt): [topics for the TREC 2017 Common Core Track](https://trec.nist.gov/data/core/core_nist.txt) -+ [`qrels.core17.txt`](../tools/topics-and-qrels/qrels.core17.txt): [qrels for the TREC 2017 Common Core Track](https://trec.nist.gov/data/core/qrels.txt) ++ [`topics.core17.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.core17.txt): [topics for the TREC 2017 Common Core Track](https://trec.nist.gov/data/core/core_nist.txt) ++ [`qrels.core17.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.core17.txt): [qrels for the TREC 2017 Common Core Track](https://trec.nist.gov/data/core/qrels.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/core18.template b/src/main/resources/docgen/templates/core18.template index 1e3bf8a3c2..e72e1a5712 100644 --- a/src/main/resources/docgen/templates/core18.template +++ b/src/main/resources/docgen/templates/core18.template @@ -27,10 +27,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.core18.txt`](../tools/topics-and-qrels/topics.core18.txt): [topics for the TREC 2018 Common Core Track](https://trec.nist.gov/data/core/topics2018.txt) -+ [`qrels.core18.txt`](../tools/topics-and-qrels/qrels.core18.txt): [qrels for the TREC 2018 Common Core Track](https://trec.nist.gov/data/core/qrels2018.txt) ++ [`topics.core18.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.core18.txt): [topics for the TREC 2018 Common Core Track](https://trec.nist.gov/data/core/topics2018.txt) ++ [`qrels.core18.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.core18.txt): [qrels for the TREC 2018 Common Core Track](https://trec.nist.gov/data/core/qrels2018.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/cw09b.template b/src/main/resources/docgen/templates/cw09b.template index 308dcd5c5f..e61c7474ef 100644 --- a/src/main/resources/docgen/templates/cw09b.template +++ b/src/main/resources/docgen/templates/cw09b.template @@ -26,16 +26,17 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: - -+ [`topics.web.1-50.txt`](../tools/topics-and-qrels/topics.web.1-50.txt): [topics for the TREC 2009 Web Track (Topics 1-50)](http://trec.nist.gov/data/web/09/wt09.topics.full.xml) -+ [`topics.web.51-100.txt`](../tools/topics-and-qrels/topics.web.51-100.txt): [topics for the TREC 2010 Web Track (Topics 51-100)](http://trec.nist.gov/data/web/10/wt2010-topics.xml) -+ [`topics.web.101-150.txt`](../tools/topics-and-qrels/topics.web.101-150.txt): [topics for the TREC 2011 Web Track (Topics 101-150)](http://trec.nist.gov/data/web/11/full-topics.xml) -+ [`topics.web.151-200.txt`](../tools/topics-and-qrels/topics.web.151-200.txt): [topics for the TREC 2012 Web Track (Topics 151-200)](http://trec.nist.gov/data/web/12/full-topics.xml) -+ [`prels.web.1-50.txt`](../tools/topics-and-qrels/prels.web.1-50.txt): [prels for the TREC 2009 Web Track (Topics 1-50, category B runs)](http://trec.nist.gov/data/web/09/prels.catB.1-50.gz) -+ [`qrels.web.51-100.txt`](../tools/topics-and-qrels/qrels.web.51-100.txt): [qrels for the TREC 2010 Web Track (Topics 51-100)](http://trec.nist.gov/data/web/10/10.adhoc-qrels.final) -+ [`qrels.web.101-150.txt`](../tools/topics-and-qrels/qrels.web.101-150.txt): [qrels for the TREC 2011 Web Track (Topics 101-150)](http://trec.nist.gov/data/web/11/qrels.adhoc) -+ [`qrels.web.151-200.txt`](../tools/topics-and-qrels/qrels.web.151-200.txt): [qrels for the TREC 2012 Web Track (Topics 151-200)](http://trec.nist.gov/data/web/12/qrels.adhoc) +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: + ++ [`topics.web.1-50.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.1-50.txt): [topics for the TREC 2009 Web Track (Topics 1-50)](http://trec.nist.gov/data/web/09/wt09.topics.full.xml) ++ [`topics.web.51-100.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.51-100.txt): [topics for the TREC 2010 Web Track (Topics 51-100)](http://trec.nist.gov/data/web/10/wt2010-topics.xml) ++ [`topics.web.101-150.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.101-150.txt): [topics for the TREC 2011 Web Track (Topics 101-150)](http://trec.nist.gov/data/web/11/full-topics.xml) ++ [`topics.web.151-200.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.151-200.txt): [topics for the TREC 2012 Web Track (Topics 151-200)](http://trec.nist.gov/data/web/12/full-topics.xml) ++ [`prels.web.1-50.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/prels.web.1-50.txt): [prels for the TREC 2009 Web Track (Topics 1-50, category B runs)](http://trec.nist.gov/data/web/09/prels.catB.1-50.gz) ++ [`qrels.web.51-100.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.51-100.txt): [qrels for the TREC 2010 Web Track (Topics 51-100)](http://trec.nist.gov/data/web/10/10.adhoc-qrels.final) ++ [`qrels.web.101-150.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.101-150.txt): [qrels for the TREC 2011 Web Track (Topics 101-150)](http://trec.nist.gov/data/web/11/qrels.adhoc) ++ [`qrels.web.151-200.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.151-200.txt): [qrels for the TREC 2012 Web Track (Topics 151-200)](http://trec.nist.gov/data/web/12/qrels.adhoc) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/cw12.template b/src/main/resources/docgen/templates/cw12.template index 6330ef38c7..85c11b4670 100644 --- a/src/main/resources/docgen/templates/cw12.template +++ b/src/main/resources/docgen/templates/cw12.template @@ -26,12 +26,13 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.web.201-250.txt`](../tools/topics-and-qrels/topics.web.201-250.txt): [topics for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/trec2013-topics.xml) -+ [`topics.web.251-300.txt`](../tools/topics-and-qrels/topics.web.251-300.txt): [topics for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/trec2014-topics.xml) -+ [`qrels.web.201-250.txt`](../tools/topics-and-qrels/qrels.web.201-250.txt): [one aspect per topic qrels for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/qrels.adhoc.txt) -+ [`qrels.web.251-300.txt`](../tools/topics-and-qrels/qrels.web.251-300.txt): [one aspect per topic qrels for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/qrels.adhoc.txt) ++ [`topics.web.201-250.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.201-250.txt): [topics for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/trec2013-topics.xml) ++ [`topics.web.251-300.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.251-300.txt): [topics for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/trec2014-topics.xml) ++ [`qrels.web.201-250.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.201-250.txt): [one aspect per topic qrels for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/qrels.adhoc.txt) ++ [`qrels.web.251-300.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.251-300.txt): [one aspect per topic qrels for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/qrels.adhoc.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/cw12b13.template b/src/main/resources/docgen/templates/cw12b13.template index c4da56d39c..d2424b1c54 100644 --- a/src/main/resources/docgen/templates/cw12b13.template +++ b/src/main/resources/docgen/templates/cw12b13.template @@ -26,12 +26,13 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.web.201-250.txt`](../tools/topics-and-qrels/topics.web.201-250.txt): [topics for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/trec2013-topics.xml) -+ [`topics.web.251-300.txt`](../tools/topics-and-qrels/topics.web.251-300.txt): [topics for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/trec2014-topics.xml) -+ [`qrels.web.201-250.txt`](../tools/topics-and-qrels/qrels.web.201-250.txt): [one aspect per topic qrels for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/qrels.adhoc.txt) -+ [`qrels.web.251-300.txt`](../tools/topics-and-qrels/qrels.web.251-300.txt): [one aspect per topic qrels for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/qrels.adhoc.txt) ++ [`topics.web.201-250.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.201-250.txt): [topics for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/trec2013-topics.xml) ++ [`topics.web.251-300.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.web.251-300.txt): [topics for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/trec2014-topics.xml) ++ [`qrels.web.201-250.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.201-250.txt): [one aspect per topic qrels for the TREC 2013 Web Track (Topics 201-250)](http://trec.nist.gov/data/web/2013/qrels.adhoc.txt) ++ [`qrels.web.251-300.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.web.251-300.txt): [one aspect per topic qrels for the TREC 2014 Web Track (Topics 251-300)](http://trec.nist.gov/data/web/2014/qrels.adhoc.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/disk12.template b/src/main/resources/docgen/templates/disk12.template index 5d89fe9509..6abeb259a8 100644 --- a/src/main/resources/docgen/templates/disk12.template +++ b/src/main/resources/docgen/templates/disk12.template @@ -26,14 +26,15 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: - -+ [`topics.adhoc.51-100.txt`](../tools/topics-and-qrels/topics.adhoc.51-100.txt): [TREC-1 Ad Hoc Topics 51-100](http://trec.nist.gov/data/topics_eng/) -+ [`topics.adhoc.101-150.txt`](../tools/topics-and-qrels/topics.adhoc.101-150.txt): [TREC-2 Ad Hoc Topics 101-150](http://trec.nist.gov/data/topics_eng/) -+ [`topics.adhoc.151-200.txt`](../tools/topics-and-qrels/topics.adhoc.151-200.txt): [TREC-3 Ad Hoc Topics 151-200](http://trec.nist.gov/data/topics_eng/) -+ [`qrels.adhoc.51-100.txt`](../tools/topics-and-qrels/qrels.adhoc.51-100.txt): [qrels for TREC-1 Ad Hoc Topics 51-100](http://trec.nist.gov/data/qrels_eng/) -+ [`qrels.adhoc.101-150.txt`](../tools/topics-and-qrels/qrels.adhoc.101-150.txt): [qrels for TREC-2 Ad Hoc Topics 101-150](http://trec.nist.gov/data/qrels_eng/) -+ [`qrels.adhoc.151-200.txt`](../tools/topics-and-qrels/qrels.adhoc.151-200.txt): [qrels for TREC-3 Ad Hoc Topics 151-200](http://trec.nist.gov/data/qrels_eng/) +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: + ++ [`topics.adhoc.51-100.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.51-100.txt): [TREC-1 Ad Hoc Topics 51-100](http://trec.nist.gov/data/topics_eng/) ++ [`topics.adhoc.101-150.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.101-150.txt): [TREC-2 Ad Hoc Topics 101-150](http://trec.nist.gov/data/topics_eng/) ++ [`topics.adhoc.151-200.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.151-200.txt): [TREC-3 Ad Hoc Topics 151-200](http://trec.nist.gov/data/topics_eng/) ++ [`qrels.adhoc.51-100.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.51-100.txt): [qrels for TREC-1 Ad Hoc Topics 51-100](http://trec.nist.gov/data/qrels_eng/) ++ [`qrels.adhoc.101-150.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.101-150.txt): [qrels for TREC-2 Ad Hoc Topics 101-150](http://trec.nist.gov/data/qrels_eng/) ++ [`qrels.adhoc.151-200.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.151-200.txt): [qrels for TREC-3 Ad Hoc Topics 151-200](http://trec.nist.gov/data/qrels_eng/) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/disk45.template b/src/main/resources/docgen/templates/disk45.template index a858d3215f..43b1bb421b 100644 --- a/src/main/resources/docgen/templates/disk45.template +++ b/src/main/resources/docgen/templates/disk45.template @@ -27,12 +27,13 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.adhoc.351-400.txt`](../tools/topics-and-qrels/topics.adhoc.351-400.txt): [TREC-7 Ad Hoc Topics 351-400](http://trec.nist.gov/data/topics_eng/) -+ [`topics.adhoc.401-450.txt`](../tools/topics-and-qrels/topics.adhoc.401-450.txt): [TREC-8 Ad Hoc Topics 401-450](http://trec.nist.gov/data/topics_eng/) -+ [`qrels.adhoc.351-400.txt`](../tools/topics-and-qrels/qrels.adhoc.351-400.txt): [qrels for TREC-7 Ad Hoc Topics 351-400](http://trec.nist.gov/data/qrels_eng/) -+ [`qrels.adhoc.401-450.txt`](../tools/topics-and-qrels/qrels.adhoc.401-450.txt): [qrels for TREC-8 Ad Hoc Topics 401-450](http://trec.nist.gov/data/qrels_eng/) ++ [`topics.adhoc.351-400.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.351-400.txt): [TREC-7 Ad Hoc Topics 351-400](http://trec.nist.gov/data/topics_eng/) ++ [`topics.adhoc.401-450.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.401-450.txt): [TREC-8 Ad Hoc Topics 401-450](http://trec.nist.gov/data/topics_eng/) ++ [`qrels.adhoc.351-400.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.351-400.txt): [qrels for TREC-7 Ad Hoc Topics 351-400](http://trec.nist.gov/data/qrels_eng/) ++ [`qrels.adhoc.401-450.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.401-450.txt): [qrels for TREC-8 Ad Hoc Topics 401-450](http://trec.nist.gov/data/qrels_eng/) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/dl19-doc-ca.template b/src/main/resources/docgen/templates/dl19-doc-ca.template index bc8c33cda1..eb3ed5c07d 100644 --- a/src/main/resources/docgen/templates/dl19-doc-ca.template +++ b/src/main/resources/docgen/templates/dl19-doc-ca.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-doc-docTTTTTquery.template b/src/main/resources/docgen/templates/dl19-doc-docTTTTTquery.template index ee193bb40c..f03798c1d8 100644 --- a/src/main/resources/docgen/templates/dl19-doc-docTTTTTquery.template +++ b/src/main/resources/docgen/templates/dl19-doc-docTTTTTquery.template @@ -42,7 +42,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-doc-hgf-wp.template b/src/main/resources/docgen/templates/dl19-doc-hgf-wp.template index 6b2873b166..3e468441f0 100644 --- a/src/main/resources/docgen/templates/dl19-doc-hgf-wp.template +++ b/src/main/resources/docgen/templates/dl19-doc-hgf-wp.template @@ -32,7 +32,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-doc-segmented-ca.template b/src/main/resources/docgen/templates/dl19-doc-segmented-ca.template index 29be8a2d9c..96fdd097fd 100644 --- a/src/main/resources/docgen/templates/dl19-doc-segmented-ca.template +++ b/src/main/resources/docgen/templates/dl19-doc-segmented-ca.template @@ -40,7 +40,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-doc-segmented-docTTTTTquery.template b/src/main/resources/docgen/templates/dl19-doc-segmented-docTTTTTquery.template index 03fdbd60c0..6fb1f5a6a9 100644 --- a/src/main/resources/docgen/templates/dl19-doc-segmented-docTTTTTquery.template +++ b/src/main/resources/docgen/templates/dl19-doc-segmented-docTTTTTquery.template @@ -43,7 +43,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-doc-segmented-unicoil-noexp.template b/src/main/resources/docgen/templates/dl19-doc-segmented-unicoil-noexp.template index 6dda97e84a..de645b06b4 100644 --- a/src/main/resources/docgen/templates/dl19-doc-segmented-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/dl19-doc-segmented-unicoil-noexp.template @@ -65,7 +65,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-doc-segmented-unicoil.template b/src/main/resources/docgen/templates/dl19-doc-segmented-unicoil.template index bba4f7f151..05e1ee971b 100644 --- a/src/main/resources/docgen/templates/dl19-doc-segmented-unicoil.template +++ b/src/main/resources/docgen/templates/dl19-doc-segmented-unicoil.template @@ -65,7 +65,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-doc-segmented-wp.template b/src/main/resources/docgen/templates/dl19-doc-segmented-wp.template index 1aa0530b30..93c84a04bd 100644 --- a/src/main/resources/docgen/templates/dl19-doc-segmented-wp.template +++ b/src/main/resources/docgen/templates/dl19-doc-segmented-wp.template @@ -33,7 +33,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-doc-segmented.template b/src/main/resources/docgen/templates/dl19-doc-segmented.template index 213bfe722a..f68f1975c4 100644 --- a/src/main/resources/docgen/templates/dl19-doc-segmented.template +++ b/src/main/resources/docgen/templates/dl19-doc-segmented.template @@ -43,7 +43,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-doc-wp.template b/src/main/resources/docgen/templates/dl19-doc-wp.template index bcb307aca2..1664751134 100644 --- a/src/main/resources/docgen/templates/dl19-doc-wp.template +++ b/src/main/resources/docgen/templates/dl19-doc-wp.template @@ -32,7 +32,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-doc.template b/src/main/resources/docgen/templates/dl19-doc.template index 110cb95006..c116a7cc60 100644 --- a/src/main/resources/docgen/templates/dl19-doc.template +++ b/src/main/resources/docgen/templates/dl19-doc.template @@ -42,7 +42,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-bm25-b8.template b/src/main/resources/docgen/templates/dl19-passage-bm25-b8.template index af18710523..dfe7653950 100644 --- a/src/main/resources/docgen/templates/dl19-passage-bm25-b8.template +++ b/src/main/resources/docgen/templates/dl19-passage-bm25-b8.template @@ -55,7 +55,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-ca.template b/src/main/resources/docgen/templates/dl19-passage-ca.template index c2bfbf3913..a0869ff6e5 100644 --- a/src/main/resources/docgen/templates/dl19-passage-ca.template +++ b/src/main/resources/docgen/templates/dl19-passage-ca.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-docTTTTTquery.template b/src/main/resources/docgen/templates/dl19-passage-docTTTTTquery.template index 8cacd0be21..65aede534a 100644 --- a/src/main/resources/docgen/templates/dl19-passage-docTTTTTquery.template +++ b/src/main/resources/docgen/templates/dl19-passage-docTTTTTquery.template @@ -32,7 +32,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-hgf-wp.template b/src/main/resources/docgen/templates/dl19-passage-hgf-wp.template index b0a703f856..d0c61e3237 100644 --- a/src/main/resources/docgen/templates/dl19-passage-hgf-wp.template +++ b/src/main/resources/docgen/templates/dl19-passage-hgf-wp.template @@ -32,7 +32,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/dl19-passage-splade-distil-cocodenser-medium.template index 7c4ca6b112..55054dbce4 100644 --- a/src/main/resources/docgen/templates/dl19-passage-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/dl19-passage-splade-distil-cocodenser-medium.template @@ -62,7 +62,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-splade-pp-ed-onnx.template b/src/main/resources/docgen/templates/dl19-passage-splade-pp-ed-onnx.template index 136521a7e5..bdf035b277 100644 --- a/src/main/resources/docgen/templates/dl19-passage-splade-pp-ed-onnx.template +++ b/src/main/resources/docgen/templates/dl19-passage-splade-pp-ed-onnx.template @@ -64,7 +64,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-splade-pp-ed.template b/src/main/resources/docgen/templates/dl19-passage-splade-pp-ed.template index bb66ca726d..6bd8702149 100644 --- a/src/main/resources/docgen/templates/dl19-passage-splade-pp-ed.template +++ b/src/main/resources/docgen/templates/dl19-passage-splade-pp-ed.template @@ -64,7 +64,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-splade-pp-sd-onnx.template b/src/main/resources/docgen/templates/dl19-passage-splade-pp-sd-onnx.template index 3ec36d2170..2051b6bafa 100644 --- a/src/main/resources/docgen/templates/dl19-passage-splade-pp-sd-onnx.template +++ b/src/main/resources/docgen/templates/dl19-passage-splade-pp-sd-onnx.template @@ -64,7 +64,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-splade-pp-sd.template b/src/main/resources/docgen/templates/dl19-passage-splade-pp-sd.template index 4c90a1b823..ac6ea3741b 100644 --- a/src/main/resources/docgen/templates/dl19-passage-splade-pp-sd.template +++ b/src/main/resources/docgen/templates/dl19-passage-splade-pp-sd.template @@ -64,7 +64,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-unicoil-noexp.template b/src/main/resources/docgen/templates/dl19-passage-unicoil-noexp.template index a1aa47adce..c32f87be33 100644 --- a/src/main/resources/docgen/templates/dl19-passage-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/dl19-passage-unicoil-noexp.template @@ -67,7 +67,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-unicoil.template b/src/main/resources/docgen/templates/dl19-passage-unicoil.template index 9841e62ae2..7be33112e2 100644 --- a/src/main/resources/docgen/templates/dl19-passage-unicoil.template +++ b/src/main/resources/docgen/templates/dl19-passage-unicoil.template @@ -67,7 +67,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage-wp.template b/src/main/resources/docgen/templates/dl19-passage-wp.template index cb497cf48e..860367cdd8 100644 --- a/src/main/resources/docgen/templates/dl19-passage-wp.template +++ b/src/main/resources/docgen/templates/dl19-passage-wp.template @@ -32,7 +32,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl19-passage.template b/src/main/resources/docgen/templates/dl19-passage.template index 98df41d438..e35903dd06 100644 --- a/src/main/resources/docgen/templates/dl19-passage.template +++ b/src/main/resources/docgen/templates/dl19-passage.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 43 topics for which NIST has provided judgments as part of the TREC 2019 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2019.html). diff --git a/src/main/resources/docgen/templates/dl20-doc-ca.template b/src/main/resources/docgen/templates/dl20-doc-ca.template index 7be439a843..f70d0b516a 100644 --- a/src/main/resources/docgen/templates/dl20-doc-ca.template +++ b/src/main/resources/docgen/templates/dl20-doc-ca.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-doc-docTTTTTquery.template b/src/main/resources/docgen/templates/dl20-doc-docTTTTTquery.template index 11cc221db7..bb19ba7679 100644 --- a/src/main/resources/docgen/templates/dl20-doc-docTTTTTquery.template +++ b/src/main/resources/docgen/templates/dl20-doc-docTTTTTquery.template @@ -42,7 +42,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-doc-hgf-wp.template b/src/main/resources/docgen/templates/dl20-doc-hgf-wp.template index 6b0292926c..95bcb5b66a 100644 --- a/src/main/resources/docgen/templates/dl20-doc-hgf-wp.template +++ b/src/main/resources/docgen/templates/dl20-doc-hgf-wp.template @@ -32,7 +32,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-doc-segmented-ca.template b/src/main/resources/docgen/templates/dl20-doc-segmented-ca.template index 420cb175c6..35e9279b7f 100644 --- a/src/main/resources/docgen/templates/dl20-doc-segmented-ca.template +++ b/src/main/resources/docgen/templates/dl20-doc-segmented-ca.template @@ -40,7 +40,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-doc-segmented-docTTTTTquery.template b/src/main/resources/docgen/templates/dl20-doc-segmented-docTTTTTquery.template index 7bd3b3ec05..feca1f26cb 100644 --- a/src/main/resources/docgen/templates/dl20-doc-segmented-docTTTTTquery.template +++ b/src/main/resources/docgen/templates/dl20-doc-segmented-docTTTTTquery.template @@ -43,7 +43,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-doc-segmented-unicoil-noexp.template b/src/main/resources/docgen/templates/dl20-doc-segmented-unicoil-noexp.template index d9651ce4ad..85d816d84f 100644 --- a/src/main/resources/docgen/templates/dl20-doc-segmented-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/dl20-doc-segmented-unicoil-noexp.template @@ -65,7 +65,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-doc-segmented-unicoil.template b/src/main/resources/docgen/templates/dl20-doc-segmented-unicoil.template index 9fa6267027..31f2fafd21 100644 --- a/src/main/resources/docgen/templates/dl20-doc-segmented-unicoil.template +++ b/src/main/resources/docgen/templates/dl20-doc-segmented-unicoil.template @@ -65,7 +65,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-doc-segmented-wp.template b/src/main/resources/docgen/templates/dl20-doc-segmented-wp.template index 12e1b106c9..23abaed0ee 100644 --- a/src/main/resources/docgen/templates/dl20-doc-segmented-wp.template +++ b/src/main/resources/docgen/templates/dl20-doc-segmented-wp.template @@ -33,7 +33,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-doc-segmented.template b/src/main/resources/docgen/templates/dl20-doc-segmented.template index 182d7f61bc..a8955fc7d5 100644 --- a/src/main/resources/docgen/templates/dl20-doc-segmented.template +++ b/src/main/resources/docgen/templates/dl20-doc-segmented.template @@ -43,7 +43,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-doc-wp.template b/src/main/resources/docgen/templates/dl20-doc-wp.template index 2bec0e4048..189c69e720 100644 --- a/src/main/resources/docgen/templates/dl20-doc-wp.template +++ b/src/main/resources/docgen/templates/dl20-doc-wp.template @@ -32,7 +32,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-doc.template b/src/main/resources/docgen/templates/dl20-doc.template index 41bddf87cd..144ebccebd 100644 --- a/src/main/resources/docgen/templates/dl20-doc.template +++ b/src/main/resources/docgen/templates/dl20-doc.template @@ -42,7 +42,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-bm25-b8.template b/src/main/resources/docgen/templates/dl20-passage-bm25-b8.template index 6cade96b96..0816158a8e 100644 --- a/src/main/resources/docgen/templates/dl20-passage-bm25-b8.template +++ b/src/main/resources/docgen/templates/dl20-passage-bm25-b8.template @@ -55,7 +55,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-ca.template b/src/main/resources/docgen/templates/dl20-passage-ca.template index 7facb5589c..d422dba92b 100644 --- a/src/main/resources/docgen/templates/dl20-passage-ca.template +++ b/src/main/resources/docgen/templates/dl20-passage-ca.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-docTTTTTquery.template b/src/main/resources/docgen/templates/dl20-passage-docTTTTTquery.template index cc1fa62fb6..b99b2b4384 100644 --- a/src/main/resources/docgen/templates/dl20-passage-docTTTTTquery.template +++ b/src/main/resources/docgen/templates/dl20-passage-docTTTTTquery.template @@ -32,7 +32,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-hgf-wp.template b/src/main/resources/docgen/templates/dl20-passage-hgf-wp.template index a87481c080..1043930fa2 100644 --- a/src/main/resources/docgen/templates/dl20-passage-hgf-wp.template +++ b/src/main/resources/docgen/templates/dl20-passage-hgf-wp.template @@ -32,7 +32,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/dl20-passage-splade-distil-cocodenser-medium.template index 1ca1ce4791..8c10bbdf5d 100644 --- a/src/main/resources/docgen/templates/dl20-passage-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/dl20-passage-splade-distil-cocodenser-medium.template @@ -62,7 +62,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-splade-pp-ed-onnx.template b/src/main/resources/docgen/templates/dl20-passage-splade-pp-ed-onnx.template index c2b0a38234..c586226458 100644 --- a/src/main/resources/docgen/templates/dl20-passage-splade-pp-ed-onnx.template +++ b/src/main/resources/docgen/templates/dl20-passage-splade-pp-ed-onnx.template @@ -64,7 +64,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-splade-pp-ed.template b/src/main/resources/docgen/templates/dl20-passage-splade-pp-ed.template index b47d1bee14..d5e081fa5e 100644 --- a/src/main/resources/docgen/templates/dl20-passage-splade-pp-ed.template +++ b/src/main/resources/docgen/templates/dl20-passage-splade-pp-ed.template @@ -64,7 +64,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-splade-pp-sd-onnx.template b/src/main/resources/docgen/templates/dl20-passage-splade-pp-sd-onnx.template index a6c38d3760..2f6aed7aff 100644 --- a/src/main/resources/docgen/templates/dl20-passage-splade-pp-sd-onnx.template +++ b/src/main/resources/docgen/templates/dl20-passage-splade-pp-sd-onnx.template @@ -64,7 +64,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-splade-pp-sd.template b/src/main/resources/docgen/templates/dl20-passage-splade-pp-sd.template index 90517e0d3a..077143544d 100644 --- a/src/main/resources/docgen/templates/dl20-passage-splade-pp-sd.template +++ b/src/main/resources/docgen/templates/dl20-passage-splade-pp-sd.template @@ -64,7 +64,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-unicoil-noexp.template b/src/main/resources/docgen/templates/dl20-passage-unicoil-noexp.template index ce3ee46ada..65622b3985 100644 --- a/src/main/resources/docgen/templates/dl20-passage-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/dl20-passage-unicoil-noexp.template @@ -67,7 +67,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-unicoil.template b/src/main/resources/docgen/templates/dl20-passage-unicoil.template index f87dd9b607..897a15cd41 100644 --- a/src/main/resources/docgen/templates/dl20-passage-unicoil.template +++ b/src/main/resources/docgen/templates/dl20-passage-unicoil.template @@ -67,7 +67,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage-wp.template b/src/main/resources/docgen/templates/dl20-passage-wp.template index 83478e660e..0b46e06cbf 100644 --- a/src/main/resources/docgen/templates/dl20-passage-wp.template +++ b/src/main/resources/docgen/templates/dl20-passage-wp.template @@ -32,7 +32,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl20-passage.template b/src/main/resources/docgen/templates/dl20-passage.template index f744794fc7..59085361fb 100644 --- a/src/main/resources/docgen/templates/dl20-passage.template +++ b/src/main/resources/docgen/templates/dl20-passage.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 54 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2020.html). diff --git a/src/main/resources/docgen/templates/dl21-doc-d2q-t5.template b/src/main/resources/docgen/templates/dl21-doc-d2q-t5.template index 8470034ecf..6eecffc298 100644 --- a/src/main/resources/docgen/templates/dl21-doc-d2q-t5.template +++ b/src/main/resources/docgen/templates/dl21-doc-d2q-t5.template @@ -36,7 +36,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-doc-segmented-d2q-t5.template b/src/main/resources/docgen/templates/dl21-doc-segmented-d2q-t5.template index d3fa1b039d..255d87f140 100644 --- a/src/main/resources/docgen/templates/dl21-doc-segmented-d2q-t5.template +++ b/src/main/resources/docgen/templates/dl21-doc-segmented-d2q-t5.template @@ -36,7 +36,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-0shot-v2.template b/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-0shot-v2.template index 7e93a83e33..737f52c797 100644 --- a/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-0shot-v2.template +++ b/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-0shot-v2.template @@ -78,7 +78,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-0shot.template b/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-0shot.template index 8be1158d58..5ba0872278 100644 --- a/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-0shot.template +++ b/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-0shot.template @@ -77,7 +77,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-noexp-0shot-v2.template b/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-noexp-0shot-v2.template index 45dbbe1f46..69d1b63dfe 100644 --- a/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-noexp-0shot-v2.template +++ b/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-noexp-0shot-v2.template @@ -78,7 +78,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-noexp-0shot.template b/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-noexp-0shot.template index 130eaba532..d77265f816 100644 --- a/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-noexp-0shot.template +++ b/src/main/resources/docgen/templates/dl21-doc-segmented-unicoil-noexp-0shot.template @@ -77,7 +77,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-doc-segmented.template b/src/main/resources/docgen/templates/dl21-doc-segmented.template index 8caffaa242..eddcef1d98 100644 --- a/src/main/resources/docgen/templates/dl21-doc-segmented.template +++ b/src/main/resources/docgen/templates/dl21-doc-segmented.template @@ -36,7 +36,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-doc.template b/src/main/resources/docgen/templates/dl21-doc.template index 75f1a4a3d4..486d91b555 100644 --- a/src/main/resources/docgen/templates/dl21-doc.template +++ b/src/main/resources/docgen/templates/dl21-doc.template @@ -36,7 +36,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 57 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-passage-augmented-d2q-t5.template b/src/main/resources/docgen/templates/dl21-passage-augmented-d2q-t5.template index b433134bd6..924548b589 100644 --- a/src/main/resources/docgen/templates/dl21-passage-augmented-d2q-t5.template +++ b/src/main/resources/docgen/templates/dl21-passage-augmented-d2q-t5.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-passage-augmented.template b/src/main/resources/docgen/templates/dl21-passage-augmented.template index 9f51c3aeef..e1727bf002 100644 --- a/src/main/resources/docgen/templates/dl21-passage-augmented.template +++ b/src/main/resources/docgen/templates/dl21-passage-augmented.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-passage-d2q-t5.template b/src/main/resources/docgen/templates/dl21-passage-d2q-t5.template index a5d8d0786c..b6a40144dd 100644 --- a/src/main/resources/docgen/templates/dl21-passage-d2q-t5.template +++ b/src/main/resources/docgen/templates/dl21-passage-d2q-t5.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-passage-splade-pp-ed.template b/src/main/resources/docgen/templates/dl21-passage-splade-pp-ed.template index a9e4b845e2..bab695a7bc 100644 --- a/src/main/resources/docgen/templates/dl21-passage-splade-pp-ed.template +++ b/src/main/resources/docgen/templates/dl21-passage-splade-pp-ed.template @@ -63,7 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-passage-splade-pp-sd.template b/src/main/resources/docgen/templates/dl21-passage-splade-pp-sd.template index 17d872b8e1..b1e03500f2 100644 --- a/src/main/resources/docgen/templates/dl21-passage-splade-pp-sd.template +++ b/src/main/resources/docgen/templates/dl21-passage-splade-pp-sd.template @@ -63,7 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-passage-unicoil-0shot.template b/src/main/resources/docgen/templates/dl21-passage-unicoil-0shot.template index 07eadecac6..ade0daeada 100644 --- a/src/main/resources/docgen/templates/dl21-passage-unicoil-0shot.template +++ b/src/main/resources/docgen/templates/dl21-passage-unicoil-0shot.template @@ -72,7 +72,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-passage-unicoil-noexp-0shot.template b/src/main/resources/docgen/templates/dl21-passage-unicoil-noexp-0shot.template index fc453c07fd..15718b35c5 100644 --- a/src/main/resources/docgen/templates/dl21-passage-unicoil-noexp-0shot.template +++ b/src/main/resources/docgen/templates/dl21-passage-unicoil-noexp-0shot.template @@ -72,7 +72,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl21-passage.template b/src/main/resources/docgen/templates/dl21-passage.template index 1b999b2ec7..ffe280a3e3 100644 --- a/src/main/resources/docgen/templates/dl21-passage.template +++ b/src/main/resources/docgen/templates/dl21-passage.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 53 topics for which NIST has provided judgments as part of the TREC 2021 Deep Learning Track. The original data can be found [here](https://trec.nist.gov/data/deep2021.html). diff --git a/src/main/resources/docgen/templates/dl22-passage-augmented-d2q-t5.template b/src/main/resources/docgen/templates/dl22-passage-augmented-d2q-t5.template index 2d0053ab99..60db1cdc59 100644 --- a/src/main/resources/docgen/templates/dl22-passage-augmented-d2q-t5.template +++ b/src/main/resources/docgen/templates/dl22-passage-augmented-d2q-t5.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/dl22-passage-augmented.template b/src/main/resources/docgen/templates/dl22-passage-augmented.template index aaa1cf3ca2..a056820ce8 100644 --- a/src/main/resources/docgen/templates/dl22-passage-augmented.template +++ b/src/main/resources/docgen/templates/dl22-passage-augmented.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/dl22-passage-d2q-t5.template b/src/main/resources/docgen/templates/dl22-passage-d2q-t5.template index cb5c4dcf64..c92b400da2 100644 --- a/src/main/resources/docgen/templates/dl22-passage-d2q-t5.template +++ b/src/main/resources/docgen/templates/dl22-passage-d2q-t5.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/dl22-passage-splade-pp-ed.template b/src/main/resources/docgen/templates/dl22-passage-splade-pp-ed.template index 5cf6081371..6861dfa807 100644 --- a/src/main/resources/docgen/templates/dl22-passage-splade-pp-ed.template +++ b/src/main/resources/docgen/templates/dl22-passage-splade-pp-ed.template @@ -63,7 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/dl22-passage-splade-pp-sd.template b/src/main/resources/docgen/templates/dl22-passage-splade-pp-sd.template index b44feaee81..78b82bf194 100644 --- a/src/main/resources/docgen/templates/dl22-passage-splade-pp-sd.template +++ b/src/main/resources/docgen/templates/dl22-passage-splade-pp-sd.template @@ -63,7 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/dl22-passage-unicoil-0shot.template b/src/main/resources/docgen/templates/dl22-passage-unicoil-0shot.template index 51286e0f45..d87499be67 100644 --- a/src/main/resources/docgen/templates/dl22-passage-unicoil-0shot.template +++ b/src/main/resources/docgen/templates/dl22-passage-unicoil-0shot.template @@ -72,7 +72,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/dl22-passage-unicoil-noexp-0shot.template b/src/main/resources/docgen/templates/dl22-passage-unicoil-noexp-0shot.template index 05bc1f2b36..c66f5e31ed 100644 --- a/src/main/resources/docgen/templates/dl22-passage-unicoil-noexp-0shot.template +++ b/src/main/resources/docgen/templates/dl22-passage-unicoil-noexp-0shot.template @@ -72,7 +72,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/dl22-passage.template b/src/main/resources/docgen/templates/dl22-passage.template index 3c5afd6c2c..4e9cab80b9 100644 --- a/src/main/resources/docgen/templates/dl22-passage.template +++ b/src/main/resources/docgen/templates/dl22-passage.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 76 topics for which NIST has provided judgments as part of the [TREC 2022 Deep Learning Track](https://trec.nist.gov/data/deep2022.html). After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/fever.template b/src/main/resources/docgen/templates/fever.template index e29924cf33..5dfeb5f27e 100644 --- a/src/main/resources/docgen/templates/fever.template +++ b/src/main/resources/docgen/templates/fever.template @@ -25,7 +25,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 9999 claims as part of the dev set for the original FEVER paper. The original data can be found [here](https://fever.ai/resources.html). diff --git a/src/main/resources/docgen/templates/fire12-bn.template b/src/main/resources/docgen/templates/fire12-bn.template index bb4ebe454c..e2ecdb476b 100644 --- a/src/main/resources/docgen/templates/fire12-bn.template +++ b/src/main/resources/docgen/templates/fire12-bn.template @@ -27,10 +27,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): -+ [`topics.fire12bn.176-225.txt`](../tools/topics-and-qrels/topics.fire12bn.176-225.txt): topics for FIRE 2012 Monolingual Bengali (176 to 225) -+ [`qrels.fire12bn.176-225.txt`](../tools/topics-and-qrels/qrels.fire12bn.176-225.txt): qrels (version II) for FIRE 2012 Monolingual Bengali (176 to 225) ++ [`topics.fire12bn.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.fire12bn.176-225.txt): topics for FIRE 2012 Monolingual Bengali (176 to 225) ++ [`qrels.fire12bn.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.fire12bn.176-225.txt): qrels (version II) for FIRE 2012 Monolingual Bengali (176 to 225) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/fire12-en.template b/src/main/resources/docgen/templates/fire12-en.template index b1ee054ef0..af02820dc8 100644 --- a/src/main/resources/docgen/templates/fire12-en.template +++ b/src/main/resources/docgen/templates/fire12-en.template @@ -27,10 +27,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): -+ [`topics.fire12en.176-225.txt`](../tools/topics-and-qrels/topics.fire12en.176-225.txt): topics for FIRE 2012 Monolingual English (176 to 225) -+ [`qrels.fire12en.176-225.txt`](../tools/topics-and-qrels/qrels.fire12en.176-225.txt): qrels (version II) for FIRE 2012 Monolingual English (176 to 225) ++ [`topics.fire12en.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.fire12en.176-225.txt): topics for FIRE 2012 Monolingual English (176 to 225) ++ [`qrels.fire12en.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.fire12en.176-225.txt): qrels (version II) for FIRE 2012 Monolingual English (176 to 225) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/fire12-hi.template b/src/main/resources/docgen/templates/fire12-hi.template index d4cfa64f2e..b33eb4e088 100644 --- a/src/main/resources/docgen/templates/fire12-hi.template +++ b/src/main/resources/docgen/templates/fire12-hi.template @@ -27,10 +27,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from the [FIRE data page](http://fire.irsi.res.in/fire/static/data): -+ [`topics.fire12hi.176-225.txt`](../tools/topics-and-qrels/topics.fire12hi.176-225.txt): topics for FIRE 2012 Monolingual Hindi (176 to 225) -+ [`qrels.fire12hi.176-225.txt`](../tools/topics-and-qrels/qrels.fire12hi.176-225.txt): qrels (version II) for FIRE 2012 Monolingual Hindi (176 to 225) ++ [`topics.fire12hi.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.fire12hi.176-225.txt): topics for FIRE 2012 Monolingual Hindi (176 to 225) ++ [`qrels.fire12hi.176-225.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.fire12hi.176-225.txt): qrels (version II) for FIRE 2012 Monolingual Hindi (176 to 225) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/gov2.template b/src/main/resources/docgen/templates/gov2.template index 755c4641f3..709010bca9 100644 --- a/src/main/resources/docgen/templates/gov2.template +++ b/src/main/resources/docgen/templates/gov2.template @@ -26,14 +26,15 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: - -+ [`topics.terabyte04.701-750.txt`](../tools/topics-and-qrels/topics.terabyte04.701-750.txt): [topics for the TREC 2004 Terabyte Track (Topics 701-750)](http://trec.nist.gov/data/terabyte/04/04topics.701-750.txt) -+ [`topics.terabyte05.751-800.txt`](../tools/topics-and-qrels/topics.terabyte05.751-800.txt): [topics for the TREC 2005 Terabyte Track (Topics 751-800)](http://trec.nist.gov/data/terabyte/05/05.topics.751-800.txt) -+ [`topics.terabyte06.801-850.txt`](../tools/topics-and-qrels/topics.terabyte06.801-850.txt): [topics for the TREC 2006 Terabyte Track (Topics 801-850)](http://trec.nist.gov/data/terabyte/06/06.topics.801-850.txt) -+ [`qrels.terabyte04.701-750.txt`](../tools/topics-and-qrels/qrels.terabyte04.701-750.txt): [qrels for the TREC 2004 Terabyte Track (Topics 701-750)](http://trec.nist.gov/data/terabyte/04/04.qrels.12-Nov-04) -+ [`qrels.terabyte05.751-800.txt`](../tools/topics-and-qrels/qrels.terabyte05.751-800.txt): [qrels for the TREC 2005 Terabyte Track (Topics 751-800)](http://trec.nist.gov/data/terabyte/05/05.adhoc_qrels) -+ [`qrels.terabyte06.801-850.txt`](../tools/topics-and-qrels/qrels.terabyte06.801-850.txt): [qrels for the TREC 2006 Terabyte Track (Topics 801-850)](http://trec.nist.gov/data/terabyte/06/qrels.tb06.top50) +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: + ++ [`topics.terabyte04.701-750.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.terabyte04.701-750.txt): [topics for the TREC 2004 Terabyte Track (Topics 701-750)](http://trec.nist.gov/data/terabyte/04/04topics.701-750.txt) ++ [`topics.terabyte05.751-800.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.terabyte05.751-800.txt): [topics for the TREC 2005 Terabyte Track (Topics 751-800)](http://trec.nist.gov/data/terabyte/05/05.topics.751-800.txt) ++ [`topics.terabyte06.801-850.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.terabyte06.801-850.txt): [topics for the TREC 2006 Terabyte Track (Topics 801-850)](http://trec.nist.gov/data/terabyte/06/06.topics.801-850.txt) ++ [`qrels.terabyte04.701-750.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.terabyte04.701-750.txt): [qrels for the TREC 2004 Terabyte Track (Topics 701-750)](http://trec.nist.gov/data/terabyte/04/04.qrels.12-Nov-04) ++ [`qrels.terabyte05.751-800.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.terabyte05.751-800.txt): [qrels for the TREC 2005 Terabyte Track (Topics 751-800)](http://trec.nist.gov/data/terabyte/05/05.adhoc_qrels) ++ [`qrels.terabyte06.801-850.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.terabyte06.801-850.txt): [qrels for the TREC 2006 Terabyte Track (Topics 801-850)](http://trec.nist.gov/data/terabyte/06/qrels.tb06.top50) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/mb11.template b/src/main/resources/docgen/templates/mb11.template index 52429eab0d..545ceb2cde 100644 --- a/src/main/resources/docgen/templates/mb11.template +++ b/src/main/resources/docgen/templates/mb11.template @@ -34,12 +34,13 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.microblog2011.txt`](../tools/topics-and-qrels/topics.microblog2011.txt): [topics for the TREC 2011 Microblog Track](https://trec.nist.gov/data/microblog/11/topics.MB1-50.txt) -+ [`topics.microblog2012.txt`](../tools/topics-and-qrels/topics.microblog2012.txt): [topics for the TREC 2012 Microblog Track](https://trec.nist.gov/data/microblog/12/2012.topics.MB51-110.txt) -+ [`qrels.microblog2011.txt`](../tools/topics-and-qrels/qrels.microblog2011.txt): [qrels for TREC 2011 Microblog Track](https://trec.nist.gov/data/microblog/11/microblog11-qrels) -+ [`qrels.microblog2012.txt`](../tools/topics-and-qrels/qrels.microblog2012.txt): [qrels for TREC 2012 Microblog Track](https://trec.nist.gov/data/microblog/12/adhoc-qrels) ++ [`topics.microblog2011.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.microblog2011.txt): [topics for the TREC 2011 Microblog Track](https://trec.nist.gov/data/microblog/11/topics.MB1-50.txt) ++ [`topics.microblog2012.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.microblog2012.txt): [topics for the TREC 2012 Microblog Track](https://trec.nist.gov/data/microblog/12/2012.topics.MB51-110.txt) ++ [`qrels.microblog2011.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.microblog2011.txt): [qrels for TREC 2011 Microblog Track](https://trec.nist.gov/data/microblog/11/microblog11-qrels) ++ [`qrels.microblog2012.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.microblog2012.txt): [qrels for TREC 2012 Microblog Track](https://trec.nist.gov/data/microblog/12/adhoc-qrels) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/mb13.template b/src/main/resources/docgen/templates/mb13.template index a377fa245f..b6710c7d72 100644 --- a/src/main/resources/docgen/templates/mb13.template +++ b/src/main/resources/docgen/templates/mb13.template @@ -34,12 +34,13 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.microblog2013.txt`](../tools/topics-and-qrels/topics.microblog2013.txt): [topics for the TREC 2013 Microblog Track](https://trec.nist.gov/data/microblog/2013/topics.MB111-170.txt) -+ [`topics.microblog2014.txt`](../tools/topics-and-qrels/topics.microblog2014.txt): [topics for the TREC 2014 Microblog Track](https://trec.nist.gov/data/microblog/2014/topics.MB171-225.txt) -+ [`qrels.microblog2013.txt`](../tools/topics-and-qrels/qrels.microblog2013.txt): [qrels for the TREC 2013 Microblog Track](https://trec.nist.gov/data/microblog/2013/qrels.txt) -+ [`qrels.microblog2014.txt`](../tools/topics-and-qrels/qrels.microblog2014.txt): [qrels for the TREC 2014 Microblog Track](https://trec.nist.gov/data/microblog/2014/qrels2014.txt) ++ [`topics.microblog2013.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.microblog2013.txt): [topics for the TREC 2013 Microblog Track](https://trec.nist.gov/data/microblog/2013/topics.MB111-170.txt) ++ [`topics.microblog2014.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.microblog2014.txt): [topics for the TREC 2014 Microblog Track](https://trec.nist.gov/data/microblog/2014/topics.MB171-225.txt) ++ [`qrels.microblog2013.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.microblog2013.txt): [qrels for the TREC 2013 Microblog Track](https://trec.nist.gov/data/microblog/2013/qrels.txt) ++ [`qrels.microblog2014.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.microblog2014.txt): [qrels for the TREC 2014 Microblog Track](https://trec.nist.gov/data/microblog/2014/qrels2014.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-doc-ca.template b/src/main/resources/docgen/templates/msmarco-doc-ca.template index 9d9769e3cb..b0c9969630 100644 --- a/src/main/resources/docgen/templates/msmarco-doc-ca.template +++ b/src/main/resources/docgen/templates/msmarco-doc-ca.template @@ -29,7 +29,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-doc-docTTTTTquery.template b/src/main/resources/docgen/templates/msmarco-doc-docTTTTTquery.template index e562c78215..e4cf4bde09 100644 --- a/src/main/resources/docgen/templates/msmarco-doc-docTTTTTquery.template +++ b/src/main/resources/docgen/templates/msmarco-doc-docTTTTTquery.template @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-doc-hgf-wp.template b/src/main/resources/docgen/templates/msmarco-doc-hgf-wp.template index f6496920ae..6922153d5a 100644 --- a/src/main/resources/docgen/templates/msmarco-doc-hgf-wp.template +++ b/src/main/resources/docgen/templates/msmarco-doc-hgf-wp.template @@ -30,8 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-doc-segmented-ca.template b/src/main/resources/docgen/templates/msmarco-doc-segmented-ca.template index 15886a256a..0046e3bffd 100644 --- a/src/main/resources/docgen/templates/msmarco-doc-segmented-ca.template +++ b/src/main/resources/docgen/templates/msmarco-doc-segmented-ca.template @@ -40,9 +40,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 45 topics for which NIST has provided judgments as part of the TREC 2020 Deep Learning Track. -The original data can be found [here](https://trec.nist.gov/data/deep2020.html). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-doc-segmented-docTTTTTquery.template b/src/main/resources/docgen/templates/msmarco-doc-segmented-docTTTTTquery.template index acb3fbf480..77842980c1 100644 --- a/src/main/resources/docgen/templates/msmarco-doc-segmented-docTTTTTquery.template +++ b/src/main/resources/docgen/templates/msmarco-doc-segmented-docTTTTTquery.template @@ -39,7 +39,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-doc-segmented-unicoil-noexp.template b/src/main/resources/docgen/templates/msmarco-doc-segmented-unicoil-noexp.template index 3f4694696a..c295dd7fa9 100644 --- a/src/main/resources/docgen/templates/msmarco-doc-segmented-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/msmarco-doc-segmented-unicoil-noexp.template @@ -65,8 +65,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-doc-segmented-unicoil.template b/src/main/resources/docgen/templates/msmarco-doc-segmented-unicoil.template index 4643fe9858..f4da0450dd 100644 --- a/src/main/resources/docgen/templates/msmarco-doc-segmented-unicoil.template +++ b/src/main/resources/docgen/templates/msmarco-doc-segmented-unicoil.template @@ -65,8 +65,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-doc-segmented-wp.template b/src/main/resources/docgen/templates/msmarco-doc-segmented-wp.template index aaeb300145..7ba14e14eb 100644 --- a/src/main/resources/docgen/templates/msmarco-doc-segmented-wp.template +++ b/src/main/resources/docgen/templates/msmarco-doc-segmented-wp.template @@ -31,7 +31,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-doc-segmented.template b/src/main/resources/docgen/templates/msmarco-doc-segmented.template index 0c091312e0..8919074056 100644 --- a/src/main/resources/docgen/templates/msmarco-doc-segmented.template +++ b/src/main/resources/docgen/templates/msmarco-doc-segmented.template @@ -39,7 +39,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-doc-wp.template b/src/main/resources/docgen/templates/msmarco-doc-wp.template index f0c0f16f86..357b16c6d2 100644 --- a/src/main/resources/docgen/templates/msmarco-doc-wp.template +++ b/src/main/resources/docgen/templates/msmarco-doc-wp.template @@ -30,7 +30,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-doc.template b/src/main/resources/docgen/templates/msmarco-doc.template index 4d736b1755..7f22ef014c 100644 --- a/src/main/resources/docgen/templates/msmarco-doc.template +++ b/src/main/resources/docgen/templates/msmarco-doc.template @@ -38,7 +38,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 5193 dev set questions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-bm25-b8.template b/src/main/resources/docgen/templates/msmarco-passage-bm25-b8.template index bf39f8992e..020f09cada 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-bm25-b8.template +++ b/src/main/resources/docgen/templates/msmarco-passage-bm25-b8.template @@ -53,7 +53,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-ca.template b/src/main/resources/docgen/templates/msmarco-passage-ca.template index 69140d5ab3..b15908fb0c 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-ca.template +++ b/src/main/resources/docgen/templates/msmarco-passage-ca.template @@ -28,7 +28,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-deepimpact.template b/src/main/resources/docgen/templates/msmarco-passage-deepimpact.template index 704d4fb147..8eca7f8854 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-deepimpact.template +++ b/src/main/resources/docgen/templates/msmarco-passage-deepimpact.template @@ -60,7 +60,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-distill-splade-max.template b/src/main/resources/docgen/templates/msmarco-passage-distill-splade-max.template index deb41e50e3..dfbe966d92 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-distill-splade-max.template +++ b/src/main/resources/docgen/templates/msmarco-passage-distill-splade-max.template @@ -61,7 +61,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-doc2query.template b/src/main/resources/docgen/templates/msmarco-passage-doc2query.template index 7cab5b56cb..ee34ae6a70 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-doc2query.template +++ b/src/main/resources/docgen/templates/msmarco-passage-doc2query.template @@ -33,7 +33,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-docTTTTTquery.template b/src/main/resources/docgen/templates/msmarco-passage-docTTTTTquery.template index d484256907..239f7eeec3 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-docTTTTTquery.template +++ b/src/main/resources/docgen/templates/msmarco-passage-docTTTTTquery.template @@ -32,7 +32,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-hgf-wp.template b/src/main/resources/docgen/templates/msmarco-passage-hgf-wp.template index 85768d67c2..7d0f406b00 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-hgf-wp.template +++ b/src/main/resources/docgen/templates/msmarco-passage-hgf-wp.template @@ -30,7 +30,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-splade-distil-cocodenser-medium.template b/src/main/resources/docgen/templates/msmarco-passage-splade-distil-cocodenser-medium.template index 5d8d3b9bfa..a3498b9dc9 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-splade-distil-cocodenser-medium.template +++ b/src/main/resources/docgen/templates/msmarco-passage-splade-distil-cocodenser-medium.template @@ -59,7 +59,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-splade-pp-ed-onnx.template b/src/main/resources/docgen/templates/msmarco-passage-splade-pp-ed-onnx.template index b3198ef0ae..8715ba7577 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-splade-pp-ed-onnx.template +++ b/src/main/resources/docgen/templates/msmarco-passage-splade-pp-ed-onnx.template @@ -61,7 +61,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-splade-pp-ed.template b/src/main/resources/docgen/templates/msmarco-passage-splade-pp-ed.template index cf2c90c54e..ce9a817141 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-splade-pp-ed.template +++ b/src/main/resources/docgen/templates/msmarco-passage-splade-pp-ed.template @@ -61,7 +61,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-splade-pp-sd-onnx.template b/src/main/resources/docgen/templates/msmarco-passage-splade-pp-sd-onnx.template index 279177897b..b273b0b53b 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-splade-pp-sd-onnx.template +++ b/src/main/resources/docgen/templates/msmarco-passage-splade-pp-sd-onnx.template @@ -61,7 +61,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-splade-pp-sd.template b/src/main/resources/docgen/templates/msmarco-passage-splade-pp-sd.template index a87556db66..adf224b5d2 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-splade-pp-sd.template +++ b/src/main/resources/docgen/templates/msmarco-passage-splade-pp-sd.template @@ -61,7 +61,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-unicoil-noexp.template b/src/main/resources/docgen/templates/msmarco-passage-unicoil-noexp.template index cee1014d51..a054518ec2 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-unicoil-noexp.template +++ b/src/main/resources/docgen/templates/msmarco-passage-unicoil-noexp.template @@ -64,7 +64,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-unicoil-tilde-expansion.template b/src/main/resources/docgen/templates/msmarco-passage-unicoil-tilde-expansion.template index 15985fbcc2..2d96003c11 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-unicoil-tilde-expansion.template +++ b/src/main/resources/docgen/templates/msmarco-passage-unicoil-tilde-expansion.template @@ -61,7 +61,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-unicoil.template b/src/main/resources/docgen/templates/msmarco-passage-unicoil.template index 7bdcd76a55..e6960a1ac1 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-unicoil.template +++ b/src/main/resources/docgen/templates/msmarco-passage-unicoil.template @@ -61,7 +61,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage-wp.template b/src/main/resources/docgen/templates/msmarco-passage-wp.template index 9d8f7cc89c..1de0811989 100644 --- a/src/main/resources/docgen/templates/msmarco-passage-wp.template +++ b/src/main/resources/docgen/templates/msmarco-passage-wp.template @@ -29,7 +29,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-passage.template b/src/main/resources/docgen/templates/msmarco-passage.template index ef951a5913..5fe34092f1 100644 --- a/src/main/resources/docgen/templates/msmarco-passage.template +++ b/src/main/resources/docgen/templates/msmarco-passage.template @@ -29,7 +29,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-doc-d2q-t5.template b/src/main/resources/docgen/templates/msmarco-v2-doc-d2q-t5.template index 81705c0f8a..4e933168e8 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-doc-d2q-t5.template +++ b/src/main/resources/docgen/templates/msmarco-v2-doc-d2q-t5.template @@ -29,8 +29,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-d2q-t5.template b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-d2q-t5.template index 3dd4d2611a..c17fd4868d 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-d2q-t5.template +++ b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-d2q-t5.template @@ -29,8 +29,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-0shot-v2.template b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-0shot-v2.template index ea5fdf4299..240ec210bd 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-0shot-v2.template +++ b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-0shot-v2.template @@ -75,8 +75,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-0shot.template b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-0shot.template index 2a1421cc23..82521f154f 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-0shot.template +++ b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-0shot.template @@ -74,8 +74,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-noexp-0shot-v2.template b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-noexp-0shot-v2.template index a22e6f2392..c819b6a863 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-noexp-0shot-v2.template +++ b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-noexp-0shot-v2.template @@ -75,8 +75,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-noexp-0shot.template b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-noexp-0shot.template index 153c82db50..960b18a5d1 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-noexp-0shot.template +++ b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented-unicoil-noexp-0shot.template @@ -74,8 +74,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented.template b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented.template index 085d359e08..56289b8b71 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-doc-segmented.template +++ b/src/main/resources/docgen/templates/msmarco-v2-doc-segmented.template @@ -30,8 +30,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-doc.template b/src/main/resources/docgen/templates/msmarco-v2-doc.template index 0f0e750ecd..bfdc5d1d33 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-doc.template +++ b/src/main/resources/docgen/templates/msmarco-v2-doc.template @@ -30,8 +30,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-doc.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-passage-augmented-d2q-t5.template b/src/main/resources/docgen/templates/msmarco-v2-passage-augmented-d2q-t5.template index 93ee93b6cf..a9a3957c13 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-passage-augmented-d2q-t5.template +++ b/src/main/resources/docgen/templates/msmarco-v2-passage-augmented-d2q-t5.template @@ -28,8 +28,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-passage-augmented.template b/src/main/resources/docgen/templates/msmarco-v2-passage-augmented.template index 13cb06ac74..f81ee17c8b 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-passage-augmented.template +++ b/src/main/resources/docgen/templates/msmarco-v2-passage-augmented.template @@ -30,8 +30,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-passage-d2q-t5.template b/src/main/resources/docgen/templates/msmarco-v2-passage-d2q-t5.template index e2be21b6f0..f61f3d0429 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-passage-d2q-t5.template +++ b/src/main/resources/docgen/templates/msmarco-v2-passage-d2q-t5.template @@ -28,8 +28,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-passage-splade-pp-ed.template b/src/main/resources/docgen/templates/msmarco-v2-passage-splade-pp-ed.template index 31cd73ba53..feb28094ae 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-passage-splade-pp-ed.template +++ b/src/main/resources/docgen/templates/msmarco-v2-passage-splade-pp-ed.template @@ -62,8 +62,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-passage-splade-pp-sd.template b/src/main/resources/docgen/templates/msmarco-v2-passage-splade-pp-sd.template index 251aa16e75..acdfc65cd1 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-passage-splade-pp-sd.template +++ b/src/main/resources/docgen/templates/msmarco-v2-passage-splade-pp-sd.template @@ -62,8 +62,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the 6980 dev set questions; see [this page](experiments-msmarco-passage.md) for more details. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-passage-unicoil-0shot.template b/src/main/resources/docgen/templates/msmarco-v2-passage-unicoil-0shot.template index ebd1adfee5..08bd5cdc49 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-passage-unicoil-0shot.template +++ b/src/main/resources/docgen/templates/msmarco-v2-passage-unicoil-0shot.template @@ -69,8 +69,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-passage-unicoil-noexp-0shot.template b/src/main/resources/docgen/templates/msmarco-v2-passage-unicoil-noexp-0shot.template index c2fdcb4537..96f945a143 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-passage-unicoil-noexp-0shot.template +++ b/src/main/resources/docgen/templates/msmarco-v2-passage-unicoil-noexp-0shot.template @@ -69,8 +69,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/msmarco-v2-passage.template b/src/main/resources/docgen/templates/msmarco-v2-passage.template index 54de0b6645..28dfb26a9f 100644 --- a/src/main/resources/docgen/templates/msmarco-v2-passage.template +++ b/src/main/resources/docgen/templates/msmarco-v2-passage.template @@ -30,8 +30,7 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -These regression experiments use the [dev queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev.txt) and the [dev2 queries](../tools/topics-and-qrels/topics.msmarco-v2-passage.dev2.txt). +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/ntcir8-zh.template b/src/main/resources/docgen/templates/ntcir8-zh.template index a7c20ea5b4..4ad88a24a7 100644 --- a/src/main/resources/docgen/templates/ntcir8-zh.template +++ b/src/main/resources/docgen/templates/ntcir8-zh.template @@ -29,10 +29,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from the [NTCIR Test Collection page](https://www.nii.ac.jp/dsc/idr/en/ntcir/ntcir.html): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from the [NTCIR Test Collection page](https://www.nii.ac.jp/dsc/idr/en/ntcir/ntcir.html): -+ [`topics.ntcir8zh.eval.txt`](../tools/topics-and-qrels/topics.ntcir8zh.eval.txt): NTCIR-8 ACLIA (IR4QA subtask), monolingual Chinese topics -+ [`qrels.ntcir8.eval.txt `](../tools/topics-and-qrels/qrels.ntcir8.eval.txt): NTCIR-8 ACLIA (IR4QA subtask) relevance judgments ++ [`topics.ntcir8zh.eval.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.ntcir8zh.eval.txt): NTCIR-8 ACLIA (IR4QA subtask), monolingual Chinese topics ++ [`qrels.ntcir8.eval.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.ntcir8.eval.txt): NTCIR-8 ACLIA (IR4QA subtask) relevance judgments After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/robust05.template b/src/main/resources/docgen/templates/robust05.template index 254c353825..ae5168a1b6 100644 --- a/src/main/resources/docgen/templates/robust05.template +++ b/src/main/resources/docgen/templates/robust05.template @@ -26,10 +26,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.robust05.txt`](../tools/topics-and-qrels/topics.robust05.txt): [topics for the TREC 2005 Robust Track (Hard Topics of Robust04)](http://trec.nist.gov/data/robust/05/05.50.topics.txt) -+ [`qrels.robust05.txt`](../tools/topics-and-qrels/qrels.robust05.txt): [qrels for the TREC 2005 Robust Track (Hard Topics of Robust04)](http://trec.nist.gov/data/robust/05/TREC2005.qrels.txt) ++ [`topics.robust05.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.robust05.txt): [topics for the TREC 2005 Robust Track (Hard Topics of Robust04)](http://trec.nist.gov/data/robust/05/05.50.topics.txt) ++ [`qrels.robust05.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.robust05.txt): [qrels for the TREC 2005 Robust Track (Hard Topics of Robust04)](http://trec.nist.gov/data/robust/05/TREC2005.qrels.txt) After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/trec02-ar.template b/src/main/resources/docgen/templates/trec02-ar.template index 9fe8f1d6ee..079cbffec7 100644 --- a/src/main/resources/docgen/templates/trec02-ar.template +++ b/src/main/resources/docgen/templates/trec02-ar.template @@ -29,10 +29,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST's page for [non-English topics](https://trec.nist.gov/data/topics_noneng/index.html) and [non-English relevance judgments](https://trec.nist.gov/data/qrels_noneng/index.html): +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST's page for [non-English topics](https://trec.nist.gov/data/topics_noneng/index.html) and [non-English relevance judgments](https://trec.nist.gov/data/qrels_noneng/index.html): -+ [`topics.trec02ar-ar.txt`](../tools/topics-and-qrels/topics.trec02ar-ar.txt): TREC 2002 cross language topics in Arabic -+ [`qrels.trec02ar.txt`](../tools/topics-and-qrels/qrels.trec02ar.txt): TREC 2002 cross language relevance judgements ++ [`topics.trec02ar-ar.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.trec02ar-ar.txt): TREC 2002 cross language topics in Arabic ++ [`qrels.trec02ar.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.trec02ar.txt): TREC 2002 cross language relevance judgements After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/wiki-all-6-3-tamber-bm25.template b/src/main/resources/docgen/templates/wiki-all-6-3-tamber-bm25.template index 3ed1fdb738..da4845ed50 100644 --- a/src/main/resources/docgen/templates/wiki-all-6-3-tamber-bm25.template +++ b/src/main/resources/docgen/templates/wiki-all-6-3-tamber-bm25.template @@ -1,8 +1,11 @@ -# Anserini Regressions: QA with wiki-all-6-3-tamber Corpus +# Anserini Regressions: QA on Wikipedia Sliding Windows **Models**: BM25 -This page documents QA regression experiments on the wiki-all-6-3-tamber corpus, which is integrated into Anserini's regression testing framework. +This page documents QA regression experiments on the `wiki-all-6-3-tamber` corpus, which is integrated into Anserini's regression testing framework. +The exact configuration here is the 6/3 sentence sliding window corpus described in the following paper: + +> Manveer Singh Tamber, Ronak Pradeep, and Jimmy Lin. [Pre-Processing Matters! Improved Wikipedia Corpora for Open-Domain Question Answering.](https://link.springer.com/chapter/10.1007/978-3-031-28241-6_11) _Proceedings of the 45th European Conference on Information Retrieval (ECIR 2023), Part III_, pages 163–176, April 2023, Dublin, Ireland. The exact configurations for these regressions are stored in [this YAML file](${yaml}). Note that this page is automatically generated from [this template](${template}) as part of Anserini's regression pipeline, so do not modify this page directly; modify the template instead. @@ -27,8 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set of multiple QA datasets, namely Natural Questions, TriviaQA, SQuAD, and WebQuestions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the test sets of Natural Questions, TriviaQA, SQuAD, and WebQuestions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/wikipedia-dpr-100w-bm25.template b/src/main/resources/docgen/templates/wikipedia-dpr-100w-bm25.template index c0dae20302..f1aaa64768 100644 --- a/src/main/resources/docgen/templates/wikipedia-dpr-100w-bm25.template +++ b/src/main/resources/docgen/templates/wikipedia-dpr-100w-bm25.template @@ -1,8 +1,8 @@ -# Anserini Regressions: QA with wikipedia-dpr-100w Corpus +# Anserini Regressions: QA on Wikipedia 100-word splits **Models**: BM25 -This page documents QA regression experiments on the wikipedia-dpr-100w corpus, which is integrated into Anserini's regression testing framework. +This page documents QA regression experiments on the `wikipedia-dpr-100w` corpus, which is integrated into Anserini's regression testing framework. The exact configurations for these regressions are stored in [this YAML file](${yaml}). Note that this page is automatically generated from [this template](${template}) as part of Anserini's regression pipeline, so do not modify this page directly; modify the template instead. @@ -27,8 +27,8 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/). -The regression experiments here evaluate on the test set of multiple QA datasets, namely Natural Questions, TriviaQA, SQuAD, and WebQuestions. +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +The regression experiments here evaluate on the test sets of Natural Questions, TriviaQA, SQuAD, and WebQuestions. After indexing has completed, you should be able to perform retrieval as follows: diff --git a/src/main/resources/docgen/templates/wt10g.template b/src/main/resources/docgen/templates/wt10g.template index f1cdd0d04d..a7c226ce03 100644 --- a/src/main/resources/docgen/templates/wt10g.template +++ b/src/main/resources/docgen/templates/wt10g.template @@ -26,10 +26,11 @@ For additional details, see explanation of [common indexing options](common-inde ## Retrieval -Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST: +Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule. +They are downloaded from NIST: -+ [`topics.adhoc.451-550.txt`](../tools/topics-and-qrels/topics.adhoc.451-550.txt): topics for the [TREC-9 Web Track](http://trec.nist.gov/data/topics_eng/topics.451-500.gz) and the [TREC 2001 Web Track](http://trec.nist.gov/data/topics_eng/topics.501-550.txt) -+ [`qrels.adhoc.451-550.txt`](../tools/topics-and-qrels/qrels.adhoc.451-550.txt): qrels for the [TREC-9 Web Track](http://trec.nist.gov/data/qrels_eng/qrels.trec9.main_web.gz) and the [TREC 2001 Web Track](http://trec.nist.gov/data/qrels_eng/adhoc_qrels.txt) ++ [`topics.adhoc.451-550.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.adhoc.451-550.txt): topics for the [TREC-9 Web Track](http://trec.nist.gov/data/topics_eng/topics.451-500.gz) and the [TREC 2001 Web Track](http://trec.nist.gov/data/topics_eng/topics.501-550.txt) ++ [`qrels.adhoc.451-550.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.adhoc.451-550.txt): qrels for the [TREC-9 Web Track](http://trec.nist.gov/data/qrels_eng/qrels.trec9.main_web.gz) and the [TREC 2001 Web Track](http://trec.nist.gov/data/qrels_eng/adhoc_qrels.txt) After indexing has completed, you should be able to perform retrieval as follows: