Kern AI

All

52 repositories

refinery-submodule-model
Public
Data model for refinery. Manages entities and their access for multiple services, e.g. the gateway.
Python
•
Apache License 2.0
•1•2•0•4•Updated Dec 20, 2024Dec 20, 2024
cicd-deployment-scripts
Public
Scripts used for Kern AI CI/CD efforts
Shell
•0•0•1•1•Updated Dec 13, 2024Dec 13, 2024
refinery-weak-supervisor
Public
Weak supervision for refinery. Manages the integration of heuristics such as labeling functions, active learners or zero-shot classifiers. Uses the weak-nlp library for the actual integration logic and algorithms.
Python
•
Apache License 2.0
•1•0•0•1•Updated Dec 13, 2024Dec 13, 2024
refinery-neural-search
Public
Neural search for refinery. Manages similarity search powered by Qdrant and outlier detection, both based on vector representations of the project records.
Python
•
Apache License 2.0
•1•5•0•2•Updated Dec 13, 2024Dec 13, 2024
refinery-embedder
Public
Embedder for refinery. Manages the creation of document- and token-level embeddings using the embedders library.
Python
•
Apache License 2.0
•1•1•0•15•Updated Dec 13, 2024Dec 13, 2024
refinery-updater
Public
Updater for refinery. Manages migration logic to new versions if required.
Python
•
Apache License 2.0
•1•0•0•1•Updated Dec 13, 2024Dec 13, 2024
refinery-tokenizer
Public
Tokenizer for refinery. Manages the creation and storage of spaCy tokens for text-based record attributes and supports multiple language models. It is used by the gateway.
Python
•
Apache License 2.0
•1•1•0•1•Updated Dec 13, 2024Dec 13, 2024
refinery-gateway
Public
Gateway for refinery. Manages incoming requests and holds the workflow logic. To interact with the gateway, the UI or Python SDK can be used.
Python
•
Apache License 2.0
•3•0•2•5•Updated Dec 13, 2024Dec 13, 2024
refinery-ml-exec-env
Public
Execution environment for the active learning module in refinery. Containerized function as a service to build active learning models using scikit-learn and sequence-learn.
Python
•
Apache License 2.0
•1•0•1•12•Updated Dec 13, 2024Dec 13, 2024
refinery-submodule-parent-images
Public
Submodule which contains the requirements of the different parent images of refinery.
Python
•
Apache License 2.0
•0•1•0•7•Updated Dec 13, 2024Dec 13, 2024
refinery-common-parent-image
Public
Defines parent image for the Docker images of the refinery services which require the integration of the model and the s3 submodule.
Shell
•
Apache License 2.0
•0•0•0•1•Updated Dec 13, 2024Dec 13, 2024
refinery-next-parent-image
Public
Dockerfile
•
Apache License 2.0
•0•0•0•1•Updated Dec 11, 2024Dec 11, 2024
refinery
Public
The data scientist's open-source choice to scale, assess and maintain natural language data. Treat training data like a software artifact.
nlp data-science natural-language-processing text-classification annotations transformers artificial-intelligence spacy supervised-learning labeling
Python
•
Apache License 2.0
•69•1.4k•70•0•Updated Dec 9, 2024Dec 9, 2024
cognition-pdf2md
Public
A PDF to Markdown converter
JavaScript
•209•0•0•0•Updated Dec 9, 2024Dec 9, 2024
refinery-websocket
Public
Websocket module for refinery. Enables asynchronous notifications inside the application.
Go
•
Apache License 2.0
•1•0•0•0•Updated Dec 9, 2024Dec 9, 2024
refinery-gateway-proxy
Public
Gateway proxy for refinery. Manages incoming requests and forwards them to the gateway. Used by the Python SDK.
Python
•
Apache License 2.0
•2•0•0•0•Updated Dec 9, 2024Dec 9, 2024
refinery-entry
Public
TypeScript
•0•0•0•2•Updated Dec 9, 2024Dec 9, 2024
refinery-authorizer
Public
Evaluates whether a user has access to certain resources.
Python
•
Apache License 2.0
•2•0•0•0•Updated Dec 9, 2024Dec 9, 2024
refinery-ui
Public
TypeScript
•0•1•0•0•Updated Dec 9, 2024Dec 9, 2024
refinery-lf-exec-env
Public
Execution environment for labeling functions in refinery. Containerized function as a service to execute user-defined Python scripts.
Python
•
Apache License 2.0
•1•0•0•9•Updated Dec 9, 2024Dec 9, 2024
refinery-ac-exec-env
Public
Execution environment for attribute calculation in refinery. Containerized function as a service to build custom attributes derived from the original data.
Python
•
Apache License 2.0
•1•0•1•7•Updated Dec 9, 2024Dec 9, 2024
refinery-exec-env-parent-image
Public
Defines parent image for the Docker images of the refinery services which provide an execution environment.
Shell
•
Apache License 2.0
•0•0•0•1•Updated Dec 9, 2024Dec 9, 2024
refinery-torch-cuda-parent-image
Public
Defines parent image for the Docker images of the refinery services that require torch (gpu).
Shell
•
Apache License 2.0
•0•0•0•1•Updated Dec 6, 2024Dec 6, 2024
refinery-torch-cpu-parent-image
Public
Defines parent image for the Docker images of the refinery services that require torch (cpu).
Shell
•
Apache License 2.0
•0•0•0•1•Updated Dec 6, 2024Dec 6, 2024
refinery-mini-parent-image
Public
Defines parent image for the Docker images of the refinery services with the smallest set of requirements.
Shell
•
Apache License 2.0
•0•0•0•1•Updated Dec 6, 2024Dec 6, 2024
submodule-react-components
Public
TypeScript
•0•0•0•0•Updated Dec 4, 2024Dec 4, 2024
refinery-python-sdk
Public
Official Python SDK for Kern AI refinery.
nlp machine-learning natural-language-processing sdk deep-learning text-classification spacy transformer supervised-learning labeling
Python
•
Apache License 2.0
•3•18•0•1•Updated Nov 14, 2024Nov 14, 2024
submodule-javascript-functions
Public
TypeScript
•0•0•0•0•Updated Nov 11, 2024Nov 11, 2024
refinery-config
Public archive
Configuration of refinery. Manages amongst others endpoints and available language models for spaCy.
Python
•
Apache License 2.0
•1•1•1•0•Updated Nov 7, 2024Nov 7, 2024
refinery-zero-shot
Public archive
Zero-shot module for refinery. Enables the integration of 🤗 Hugging Face zero-shot classifiers as an off-the-shelf no-code heuristic.
Python
•
Apache License 2.0
•1•0•0•0•Updated Oct 25, 2024Oct 25, 2024