Skip to content

a CRF based entity extraction project with features coming from expert.ai edge NL API - CoNLL Dataset

License

Notifications You must be signed in to change notification settings

nluninja/ner_expertai_crf

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Named Entity Recognition with CRF and expert.ai Edge NL API

The notebook shows how to improve the performance of the CRF algorithm about named entity recognition, using expert.ai edge NL API as feature generation step.
The task has been trained and measured with reference to CoNLL 2003 dataset; the notebook downloads the dataset from this https://github.com/nluninja/nlp_datasets.

Load the required dependencies

it requires sklearn-crfsuite and edge-nlapi libraries.

conda env create -f environment.yml

conda activate crf-ner

Get expert.ai edge NL API

Edge NL API is a local runtime for the expert.ai Edge NL API. For this task, I use edge NL Api as feature generation step relying on the metadata generated by the NLP engine. Create your project in expert.ai studio, and then deploy the edge instance selecting _Studio-->Deploy. Then run

runmeWindows.bat

or
runmeLinux.sh

according to your environment

Edge NL API is free to use; it only requires an account creation at https://developer.expert.ai for being able to use it.

About

a CRF based entity extraction project with features coming from expert.ai edge NL API - CoNLL Dataset

Topics

Resources

License

Stars

Watchers

Forks