Skip to content

v1.2.0
Compare
Choose a tag to compare
@afedukov afedukov released this 08 Nov 14:50
· 9 commits to main since this release
v1.2.0
d3fe222

Changelist

  • New Scale Type "Detail" with Corresponding Metrics: Introduced a new scale type called Detail, which allows grading search results on a scale from 1 to 10. Corresponding metrics for this scale include:

    • CG(d)@k - Cumulative Gain
    • DCG(d)@k - Discounted Cumulative Gain
    • nDCG(d)@k - Normalized Discounted Cumulative Gain
    Screenshot 2024-11-08 at 12 35 36

  • Support for Multiple Scale Types in Evaluations: Evaluations are no longer restricted to metrics of the same scale type (binary, graded, or detail). You can now include metrics of different types within a single evaluation. If an evaluation includes metrics from different scales, you need to define Transformers, a new feature that allows converting grades from one scale to another. The scale and transformers are set during the creation of the evaluation and cannot be changed after it starts.

    Screenshot 2024-11-08 at 12 37 03

  • Various Bug Fixes and Minor Improvements: Resolved several issues to improve application stability and performance, and made minor user interface improvements for a more intuitive experience.

Assets 2
Loading