Skip to content

Commit

Permalink
docs: add description to readme (#71)
Browse files Browse the repository at this point in the history
* docs: add description to readme

* Update console_recipe.yaml

* docs: add list of metadata

---------

Co-authored-by: kay_alave <kay.alave@gmail.com>
  • Loading branch information
eyelesbarrow and kay_alave authored Jul 10, 2023
1 parent 58fe048 commit bbbdbe2
Show file tree
Hide file tree
Showing 2 changed files with 20 additions and 6 deletions.
14 changes: 14 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,20 @@

Add your SAP Hana databases to your Linkedin Datahub!

# Description
This python package extracts views metadata from SAP Hana db to push it to Datahub. These includes:
- Table schema with datatypes
- View definitions
- View lineages with support for cross-schema references and column-level lineages

The metadata from SAP Hana are extracted and parsed using sqlalchemy (for table lineage) and sqlglot (for column lineage).

### Recipe File
The recipe file for the source file supports ingestion of both table and column lineage via the Datahub CLI.
The ingestion config file can also specify specific schemas to exclude and include, allowing for the creation of lineage across different schemas in a SAP Hana db.
Results can be seen in the Datahub UI or printed in the console, or file.


## Installing

Pre-built Wheels can be downloaded from the [Releases page](https://github.com/contiamo/datahub-sap-hana/releases/latest)
Expand Down
12 changes: 6 additions & 6 deletions console_recipe.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -30,10 +30,10 @@ source:
"urn:li:domain:sales":
allow:
- "HOTEL"
#sink:
#type: console"""

sink:
type: file
config:
filename: ./sap_hana_results.json
type: console

# sink:
# type: file
# config:
# filename: ./sap_hana_results.json

0 comments on commit bbbdbe2

Please sign in to comment.