Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(ingestion): Add -e flag to uv command in ingestion Dockerfiles #10114

Merged
merged 9 commits into from
Apr 10, 2024
Merged

feat(ingestion): Add -e flag to uv command in ingestion Dockerfiles #10114

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
2f7d7da
feat(ingestion): Custom names for datahub and datahub-airflow-plugin …
skrydal Mar 22, 2024
ae0decd
Linting
skrydal Mar 22, 2024
651ec55
Merge branch 'master' into feat_custom_pip_package_name
skrydal Mar 26, 2024
bd4590b
Merge branch 'master' into feat_custom_pip_package_name
skrydal Mar 27, 2024
5960091
Reverting custom packages naming
skrydal Apr 8, 2024
104c568
Merge branch 'master' into feat_custom_pip_package_name
skrydal Apr 8, 2024
702bf0f
Changed uv install command to use "-e" in ingestion Dockerfiles
skrydal Apr 8, 2024
27a4983
Merge branch 'master' into feat_custom_pip_package_name
skrydal Apr 8, 2024
3f3c01e
Merge branch 'master' into feat_custom_pip_package_name
hsheth2 Apr 9, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docker/datahub-ingestion/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ RUN sed -i.bak "s/__version__ = \"1\!0.0.0.dev0\"/__version__ = \"$(echo $RELEAS

FROM base as slim-install

RUN uv pip install --no-cache "acryl-datahub[base,datahub-rest,datahub-kafka,snowflake,bigquery,redshift,mysql,postgres,hive,clickhouse,glue,dbt,looker,lookml,tableau,powerbi,superset,datahub-business-glossary] @ ."
RUN uv pip install --no-cache -e ".[base,datahub-rest,datahub-kafka,snowflake,bigquery,redshift,mysql,postgres,hive,clickhouse,glue,dbt,looker,lookml,tableau,powerbi,superset,datahub-business-glossary]"

FROM base as full-install-build

Expand All @@ -40,7 +40,7 @@ RUN apt-get update && apt-get install -y -qq maven
USER datahub
COPY ./docker/datahub-ingestion/pyspark_jars.sh .

RUN uv pip install --no-cache "acryl-datahub[base,all] @ ." "acryl-datahub-airflow-plugin[plugin-v2] @ ./airflow-plugin" && \
RUN uv pip install --no-cache -e ".[base,all]" "./airflow-plugin[plugin-v2]" && \
datahub --version
RUN ./pyspark_jars.sh

Expand Down
2 changes: 1 addition & 1 deletion docker/datahub-ingestion/Dockerfile-slim-only
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ RUN sed -i.bak "s/__version__ = \"1\!0.0.0.dev0\"/__version__ = \"$(echo $RELEAS

FROM base as slim-install

RUN uv pip install --no-cache "acryl-datahub[base,datahub-rest,datahub-kafka,snowflake,bigquery,redshift,mysql,postgres,hive,clickhouse,glue,dbt,looker,lookml,tableau,powerbi,superset,datahub-business-glossary] @ ." && \
RUN uv pip install --no-cache -e ".[base,datahub-rest,datahub-kafka,snowflake,bigquery,redshift,mysql,postgres,hive,clickhouse,glue,dbt,looker,lookml,tableau,powerbi,superset,datahub-business-glossary]" && \
datahub --version

FROM slim-install as final
Expand Down
Loading