Run DBT Models using dbt-spark

[vignesh-clustrex]

I need to move data from one table to another in postgres databse, using dbt with dbt-spark. I need transformations to happen in spark server and insert the data to postgres database, since we need to reduce the read load in aws postgres rds.

Any solution for this? Is this possible ?

[JCZuurmond]

Add JDBC connection details to your dbt models so that the tables become external tables pointing to locations in your database.

Note: JDBC connections can become a bottleneck, investigate that

[vignesh-clustrex]

Thanks @JCZuurmond, jdbc connection for postgres right ?

[JCZuurmond]

yes