Skip to content

Commit

Permalink
fix: Update eval metric according to the new vertexai eval package.
Browse files Browse the repository at this point in the history
  • Loading branch information
anubhav756 committed Nov 13, 2024
1 parent fb2925e commit 3a2e8fd
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llm_demo/evaluation/evaluation.py
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ def evaluate_retrieval_phase(
"""
Run evaluation for the ability of a model to select the right tool and arguments (retrieval phase).
"""
metrics = ["tool_call_quality"]
metrics = ["tool_call_valid"]
# Prepare evaluation task input
responses = []
references = []
Expand Down

0 comments on commit 3a2e8fd

Please sign in to comment.