More verbose logging output for compare m2

[sam-writer]

I have found the following additional information useful when using the verbose output of ERRANT, and wanted to see if you were interested in merging it.

It adds:

• the original sentence
• the category of each hypothesis and reference edit
• a summary table of categories and TP/FP/FN

Example verbose output now looks like

----------------------------------------
Original sentence 8: Would you like   me to see if I can get a coy of the quote ?
----------------------------------------
SENTENCE 8 - HYP 0 - REF 0
HYPOTHESIS EDITS : [(3, 4, '', 'U:SPACE'), (12, 13, 'copy', 'R:NOUN')]
REFERENCE EDITS  : [(3, 4, '', 'U:SPACE'), (12, 13, 'copy', 'R:NOUN'), (17, 17, '( SOMETHING ELSE )', 'M:OTHER')]
Local TP/FP/FN   : 2 0 1
Local P/R/F0.5  : 1.0 0.6667 0.9091
Global TP/FP/FN  : 5 1 7
Global P/R/F0.5  : 0.8333 0.4167 0.6944
----------------------------------------
SENTENCE 8 - HYP 0 - REF 1
HYPOTHESIS EDITS : [(3, 4, '', 'U:SPACE'), (12, 13, 'copy', 'R:NOUN')]
REFERENCE EDITS  : [(3, 4, '', 'U:SPACE'), (12, 13, 'copy', 'R:NOUN'), (17, 17, '( SOMETHING ELSE  )', 'M:OTHER')]
Local TP/FP/FN   : 2 0 1
Local P/R/F0.5  : 1.0 0.6667 0.9091
Global TP/FP/FN  : 5 1 7
Global P/R/F0.5  : 0.8333 0.4167 0.6944
----------------------------------------
SENTENCE 8 - HYP 0 - REF 2
HYPOTHESIS EDITS : [(3, 4, '', 'U:SPACE'), (12, 13, 'copy', 'R:NOUN')]
REFERENCE EDITS  : [(3, 4, '', 'U:SPACE'), (12, 13, 'copy', 'R:NOUN'), (17, 17, '( SOMETHING ELSE  )', 'M:OTHER')]
Local TP/FP/FN   : 2 0 1
Local P/R/F0.5  : 1.0 0.6667 0.9091
Global TP/FP/FN  : 5 1 7
Global P/R/F0.5  : 0.8333 0.4167 0.6944
----------------------------------------
SENTENCE 8 - HYP 0 - REF 3
HYPOTHESIS EDITS : [(3, 4, '', 'U:SPACE'), (12, 13, 'copy', 'R:NOUN')]
REFERENCE EDITS  : [(3, 4, '', 'U:SPACE'), (12, 13, 'copy', 'R:NOUN'), (17, 17, '( SOMETHING ELSE  )', 'M:OTHER')]
Local TP/FP/FN   : 2 0 1
Local P/R/F0.5  : 1.0 0.6667 0.9091
Global TP/FP/FN  : 5 1 7
Global P/R/F0.5  : 0.8333 0.4167 0.6944
----------------------------------------
SENTENCE 8 - HYP 0 - REF 4
HYPOTHESIS EDITS : [(3, 4, '', 'U:SPACE'), (12, 13, 'copy', 'R:NOUN')]
REFERENCE EDITS  : [(3, 4, '', 'U:SPACE'), (12, 13, 'copy', 'R:NOUN'), (17, 17, '( SOMETHING ELSE  )', 'M:OTHER')]
Local TP/FP/FN   : 2 0 1
Local P/R/F0.5  : 1.0 0.6667 0.9091
Global TP/FP/FN  : 5 1 7
Global P/R/F0.5  : 0.8333 0.4167 0.6944
----------------------------------------
^^ HYP 0, REF 0 chosen for sentence 8
Local results:
   Category   TP   FP   FN
    U:SPACE    1    0    0
     R:NOUN    1    0    0
    M:OTHER    0    0    1

[chrisjbryant]

Hi Sam, sorry it took so long but merging this now. Hope you're well!