Skip to content

Commit

Permalink
fix: update dataset split parameter in CEvalEvaluator
Browse files Browse the repository at this point in the history
  • Loading branch information
Ki-Seki committed Nov 12, 2024
1 parent 82e7874 commit 5b8d9d9
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/eval_suite/benchs/ceval/eval_ceval.py
Original file line number Diff line number Diff line change
Expand Up @@ -66,7 +66,7 @@ def __init__(
# ─── Load Examples For Few-shot Learning ──────────────────────

if num_shots > 0:
ds = CEvalDataset(self.disciplines, split="dev")
ds = CEvalDataset(self.disciplines, split=self.split)
self.discipline_examples = ds.load_as_dict_of_discipline(num_shots)
else:
self.discipline_examples = {}
Expand Down

0 comments on commit 5b8d9d9

Please sign in to comment.