This small utility extracts tokens from the (ill-formed) COW XML format and stores it as CoNLL-X.
Currently it extracts:
- Tokens.
- Quality estimations (bdc/bpc) as features.
cow-extract can read/write from stdin/stdout or files. E.g. from files:
cow-extract somecorpus.xml somecorpus.conll
Using stdin/stdout is especially useful in combination with gzip:
zcat somecorpus.xml.gz | cow-extract | gzip - > somecorpus.conll.gz