Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Task]: Make Python base image requirements compatible with ARM #26876

Closed
1 of 15 tasks
celeste-zeng opened this issue May 24, 2023 · 1 comment
Closed
1 of 15 tasks

[Task]: Make Python base image requirements compatible with ARM #26876

celeste-zeng opened this issue May 24, 2023 · 1 comment
Assignees
Labels
done & done Issue has been reviewed after it was closed for verification, followups, etc. P2 python task

Comments

@celeste-zeng
Copy link
Contributor

What needs to happen?

Hi,

I just tried to build the Beam Python3.10 SDK container for ARM by running ./gradlew -Pcontainer-architecture-list=arm64 :sdks:python:container:py310:docker.

However, the build failed with the error saying:
#39 [linux/arm64 beam 11/16] RUN pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate" && exit 1) #39 20.81 tensorflow 2.12.0 requires tensorflow-cpu-aws, which is not installed.

Then I tried to manually install tensorflow-cpu-aws from my x86_64 machine but got the following error:
ERROR: Could not find a version that satisfies the requirement tensorflow-cpu-aws (from versions: none) ERROR: No matching distribution found for tensorflow-cpu-aws. So I wonder if tensorflow-cpu-aws can only be installed on ARM machines.

After I delete tensorflow 2.12.0 in the base_image_requirements.txt for Python3.10, the build will succeed. The issue exists for all versions of Python so it will be nice to make Python base image requirements compatible with ARM.

Thanks!

Issue Priority

Priority: 2 (default / most normal work should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner
@celeste-zeng
Copy link
Contributor Author

.take-issue

@celeste-zeng celeste-zeng reopened this May 24, 2023
@github-actions github-actions bot added this to the 2.49.0 Release milestone May 24, 2023
@Abacn Abacn removed this from the 2.49.0 Release milestone May 24, 2023
@github-actions github-actions bot added this to the 2.51.0 Release milestone Aug 30, 2023
@damccorm damccorm added the done & done Issue has been reviewed after it was closed for verification, followups, etc. label Sep 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
done & done Issue has been reviewed after it was closed for verification, followups, etc. P2 python task
Projects
None yet
Development

No branches or pull requests

3 participants