Skip to content

Commit

Permalink
Skip adding start/end tuple if key not found (#904)
Browse files Browse the repository at this point in the history
skip adding start/end tuple if key not found
  • Loading branch information
DhruvaBansal00 authored Sep 25, 2024
1 parent 5171761 commit 183a77d
Showing 1 changed file with 4 additions and 3 deletions.
7 changes: 4 additions & 3 deletions src/autolabel/confidence.py
Original file line number Diff line number Diff line change
Expand Up @@ -192,9 +192,10 @@ def logprob_average_per_key(
# We did not find the key in the logprobs so we set its confidence as 0
# This should not be possible if the LLM followed its guidelines.
logprob_per_key[key] = 0
start_token = mapping[loc]
end_token = mapping[loc + len(key_to_find) - 1]
locations.append((start_token, end_token, key))
else:
start_token = mapping[loc]
end_token = mapping[loc + len(key_to_find) - 1]
locations.append((start_token, end_token, key))
locations.sort()
# Here, the locations consist of the start and end *token* indices for each key
# i.e for the keys A and B, we find the start and end tokens where they are found in the logprobs list
Expand Down

0 comments on commit 183a77d

Please sign in to comment.