Perplexity scores #401
Unanswered
emarcus255
asked this question in
Q&A
Replies: 1 comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi.
I am trying to calculate perplexity scores on my data set using marian-scorer and to be honest I am not sure if I am doing it correctly and if the scores returned by marian-scorer are the right one.
marian-scorer -m model/model.npz -v model/spm-src.spm model/spm-trg.spm -t data/source.test.src data/source.test.trg > marian_psppl.score
I know in the --summary parameter I can pass what type of score to get but what actually scores I am getting for each sentence of my data set (without passing the summary option)? The scores I am getting have all negative value what makes me wonder if they are correct.
Beta Was this translation helpful? Give feedback.
All reactions