Skip to content

1.25.2

Compare
Choose a tag to compare
@KennethEnevoldsen KennethEnevoldsen released this 20 Dec 15:49
· 12 commits to main since this release

1.25.2 (2024-12-20)

Fix

Unknown

  • Add IBM Granite Embedding Models (#1613)

  • add IBM granite embedding models

  • lint formatting

  • add adapted_from and superseded_by to ModelMeta (ad05983)

  • Feat: Evaluate missing languages (#1584)

  • init

  • fix tests

  • update mock retrieval

  • update tests

  • use subsets instead of langs

  • Apply suggestions from code review
    Co-authored-by: Isaac Chung <chungisaac1217@gmail.com>

  • fix tests

  • add to readme

  • rename subset in readme


Co-authored-by: Isaac Chung <chungisaac1217@gmail.com> (48cb97d)

  • Update tasks table (9de7f20)

  • Add NanoBEIR Datasets (#1588)

  • add NanoClimateFeverRetrieval task, still requires some debugging

  • move task to correct place in init file

  • add all Nano datasets and results

  • format code

  • Update mteb/tasks/Retrieval/eng/tempCodeRunnerFile.py
    Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>

  • pin revision to commit and add datasets to benchmark.py

  • create new benchmark for NanoBEIR

  • add revision when loading datasets

  • lint


Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
Co-authored-by: isaac-chung <chungisaac1217@gmail.com> (6731b94)

  • Feat: Use similarity scores if available (#1602)

  • Use similarity scores if available

  • lint (b81b584)