Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request] WARNING sacrebleu:bleu.py:418 It is recommended to enable effective_order for sentence-level BLEU. #732

Closed
vkehfdl1 opened this issue Sep 23, 2024 · 0 comments · Fixed by #748
Closed

[Feature Request] WARNING sacrebleu:bleu.py:418 It is recommended to enable effective_order for sentence-level BLEU. #732

vkehfdl1 opened this issue Sep 23, 2024 · 0 comments · Fixed by #748
Labels
enhancement New feature or request

Comments

@vkehfdl1
Copy link
Contributor

Is your feature request related to a problem? Please describe.
I got this warning message when I use BLEU

WARNING  sacrebleu:bleu.py:418 It is recommended to enable `effective_order` for sentence-level BLEU.

Describe the solution you'd like
I think we can enable effective_order, and investigate what is it

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
pip freeze | grep -i sacrebleu
sacrebleu==2.4.2
@vkehfdl1 vkehfdl1 added the enhancement New feature or request label Sep 23, 2024
@vkehfdl1 vkehfdl1 mentioned this issue Sep 26, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

add effective_order at bleu as True Marker-Inc-Korea/AutoRAG
1 participant
@vkehfdl1