1.1.2 New English, German, Korean datasets & bug fixes
What's Changed
- fix RerankingEvaluator's compute_metrics_individual by @novak2000 in #165
- Add Long Document Evaluation Datasets by @violenil in #166
- Fix medrxiv mislinkage by @zhimin-z in #187
- Fix Dalaj linkage by @zhimin-z in #195
- Fix SummEval linkage by @zhimin-z in #194
- Fix SweFAQ linkage by @zhimin-z in #193
- Added Norwegian Bokmål-Nynorsk bitext mining task by @x-tabdeveloping in #202
- Add support for cache results by @hongjin-su in #207
- Retrieval benchmark based on GermanQuAD by @rasdani in #197
- Refer to other works by @Muennighoff in #212
- Fix selection of DRES/DRPES by @Markus28 in #179
- Add tasks for German Embedding Evaluation by @guenthermi in #214
- only save top-k by @hongjin-su in #209
- Add MultiLongDocRetrieval task to MTEB. by @hanhainebula in #224
- Add Korean Text Search Tasks to MTEB by @taeminlee in #210
- Update BeIRPLTask.py by @kwojtasi in #225
- Add task list by @Muennighoff in #228
New Contributors
- @novak2000 made their first contribution in #165
- @violenil made their first contribution in #166
- @zhimin-z made their first contribution in #187
- @x-tabdeveloping made their first contribution in #202
- @hongjin-su made their first contribution in #207
- @rasdani made their first contribution in #197
- @Markus28 made their first contribution in #179
- @hanhainebula made their first contribution in #224
- @taeminlee made their first contribution in #210
Full Changelog: 1.1.1...1.1.2