Skip to content

Commit

Permalink
Update regression docs to fix broken links (#2137)
Browse files Browse the repository at this point in the history
Closes #2123
  • Loading branch information
lintool committed Jun 8, 2023
1 parent 3e5d61a commit 17d5fc7
Show file tree
Hide file tree
Showing 577 changed files with 1,037 additions and 613 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -255,7 +255,7 @@ See individual pages for details!
+ Regressions for Complex Answer Retrieval (CAR17): [v1.5](docs/regressions-car17v1.5.md), [v2.0](docs/regressions-car17v2.0.md), [v2.0 with doc2query](docs/regressions-car17v2.0-doc2query.md)
+ Regressions for TREC News Tracks (Background Linking Task): [2018](docs/regressions-backgroundlinking18.md), [2019](docs/regressions-backgroundlinking19.md), [2020](docs/regressions-backgroundlinking20.md)
+ Regressions for [FEVER Fact Verification](docs/regressions-fever.md)
+ Regressions for DPR Wikipedia QA baselines: [100-word splits](docs/regressions-wikipedia-dpr-100w-bm25.md)
+ Regressions for DPR Wikipedia QA baselines: [100-word splits](docs/regressions-wikipedia-dpr-100w-bm25.md), [6/3 sliding window sentences](docs/regressions-wiki-all-6-3-tamber-bm25.md)

</details>

Expand Down
9 changes: 5 additions & 4 deletions docs/regressions-backgroundlinking18.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Anserini Regressions: TREC 2018 News Track (Background Linking)
# Anserini Regressions: TREC 2018 News Background Linking

**Models**: various bag-of-words approaches

Expand Down Expand Up @@ -33,10 +33,11 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST:
Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.
They are downloaded from NIST:

+ [`topics.backgroundlinking18.txt`](../tools/topics-and-qrels/topics.backgroundlinking18.txt): [topics for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/newsir18-topics.txt)
+ [`qrels.backgroundlinking18.txt`](../tools/topics-and-qrels/qrels.backgroundlinking18.txt): [qrels for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/bqrels.exp-gains.txt)
+ [`topics.backgroundlinking18.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking18.txt): [topics for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/newsir18-topics.txt)
+ [`qrels.backgroundlinking18.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.backgroundlinking18.txt): [qrels for the background linking task of the TREC 2018 News Track](https://trec.nist.gov/data/news/2018/bqrels.exp-gains.txt)

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
9 changes: 5 additions & 4 deletions docs/regressions-backgroundlinking19.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Anserini Regressions: TREC 2019 News Track (Background Linking)
# Anserini Regressions: TREC 2019 News Background Linking

**Models**: various bag-of-words approaches

Expand Down Expand Up @@ -33,10 +33,11 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST:
Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.
They are downloaded from NIST:

+ [`topics.backgroundlinking19.txt`](../tools/topics-and-qrels/topics.backgroundlinking19.txt): topics for the background linking task of the TREC 2019 News Track
+ [`qrels.backgroundlinking19.txt`](../tools/topics-and-qrels/qrels.backgroundlinking19.txt): qrels for the background linking task of the TREC 2019 News Track
+ [`topics.backgroundlinking19.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking19.txt): topics for the background linking task of the TREC 2019 News Track
+ [`qrels.backgroundlinking19.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.backgroundlinking19.txt): qrels for the background linking task of the TREC 2019 News Track

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
9 changes: 5 additions & 4 deletions docs/regressions-backgroundlinking20.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Anserini Regressions: TREC 2020 News Track (Background Linking)
# Anserini Regressions: TREC 2020 News Background Linking

**Models**: various bag-of-words approaches

Expand Down Expand Up @@ -33,10 +33,11 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/), downloaded from NIST:
Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.
They are downloaded from NIST:

+ [`topics.backgroundlinking20.txt`](../tools/topics-and-qrels/topics.backgroundlinking20.txt): topics for the background linking task of the TREC 2020 News Track
+ [`qrels.backgroundlinking20.txt`](../tools/topics-and-qrels/qrels.backgroundlinking20.txt): qrels for the background linking task of the TREC 2020 News Track
+ [`topics.backgroundlinking20.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/topics.backgroundlinking20.txt): topics for the background linking task of the TREC 2020 News Track
+ [`qrels.backgroundlinking20.txt`](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels/qrels.backgroundlinking20.txt): qrels for the background linking task of the TREC 2020 News Track

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-arguana-flat-wp.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-arguana-flat.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-arguana-multifield.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/).
The regression experiments here evaluate on the test set questions.
Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-arguana-unicoil-noexp.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-bioasq-flat-wp.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-bioasq-flat.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-bioasq-multifield.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/).
The regression experiments here evaluate on the test set questions.
Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-bioasq-unicoil-noexp.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-climate-fever-flat-wp.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-climate-fever-flat.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-climate-fever-multifield.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/).
The regression experiments here evaluate on the test set questions.
Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-climate-fever-unicoil-noexp.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-cqadupstack-android-flat-wp.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-cqadupstack-android-flat.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/).
The regression experiments here evaluate on the test set questions.
Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-cqadupstack-english-flat-wp.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-cqadupstack-english-flat.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/).
The regression experiments here evaluate on the test set questions.
Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat-wp.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-cqadupstack-gaming-multifield.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/).
The regression experiments here evaluate on the test set questions.
Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-cqadupstack-gis-flat-wp.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-cqadupstack-gis-flat.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-cqadupstack-gis-multifield.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -63,8 +63,7 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored in [`tools/topics-and-qrels/`](../tools/topics-and-qrels/).
The regression experiments here evaluate on the test set questions.
Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

Expand Down
2 changes: 2 additions & 0 deletions docs/regressions-beir-v1.0.0-cqadupstack-gis-unicoil-noexp.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,8 @@ For additional details, see explanation of [common indexing options](common-inde

## Retrieval

Topics and qrels are stored [here](https://github.com/castorini/anserini-tools/tree/master/topics-and-qrels), which is linked to the Anserini repo as a submodule.

After indexing has completed, you should be able to perform retrieval as follows:

```
Expand Down
Loading

0 comments on commit 17d5fc7

Please sign in to comment.