Skip to content
This repository has been archived by the owner on Feb 21, 2024. It is now read-only.

Latest commit

 

History

History
73 lines (48 loc) · 2.12 KB

com-ingest-manage.md

File metadata and controls

73 lines (48 loc) · 2.12 KB
title layout has_children nav_order has_toc
Import data
default
true
5
false

How do I import data to FeatureBase Community?

{: .no_toc}

This overview explains the process of importing data to FeatureBase using three methods:

  • CSV
  • SQL
  • Apache Kafka

{% include page-toc.md %}

Before you begin

{% include /com-install/com-install-before-begin.md %}

What are ingesters?

Ingesters are used to:

  • retrieve data from a specified upstream data source
  • transform the data to the FeatureBase bit-columnar format
  • write that data to target database tables.

{: .note} Tables defined by ingest source files are created if they do not already exist.

Perform data modeling

{% include /concepts/summary-data-modeling.md %}

Import data

You can import data to FeatureBase running three types of ingester processes:

  • CSV ingest
  • SQL ingest
  • Kafka ingest

CSV ingest

Learn how to build CSV source files and the ingest flags you use to import your data.

SQL import method

Learn how to define your SQL source and ingest flags to import the data.

Kafka import methods

Learn how to define Avro and Static Schema source files and valid ingest flags to import your data.

Troubleshooting