Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Adds a BERT feature extractor (#116)
* Initial commit of BERTFeatureExtractor. * Updates for the integrated version of WordpieceTokenizer. * Repackaging org.tribuo.interop.onnx.bert to org.tribuo.interop.onnx.extractors. * BERTFeatureExtractor now implements TextPipeline, so you can use it in a RowProcessor via TextFieldProcessor. * Adding hugginface transformers to THIRD_PARTY_LICENSES.txt * Adding copyright statements. * Adding another constructor to BERTFeatureExtractor. * Adding a test for example extraction. * Relaxing the fp comparison. * Fixing review comments.
- Loading branch information