-
Notifications
You must be signed in to change notification settings - Fork 4.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Dataflow Streaming] Use isolated windmill streams based on job settings #32503
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
arunpandianp
force-pushed
the
separatestreams
branch
3 times, most recently
from
September 20, 2024 04:29
3085cf0
to
295f9d0
Compare
arunpandianp
force-pushed
the
separatestreams
branch
from
September 20, 2024 05:28
295f9d0
to
9cb292a
Compare
arunpandianp
changed the title
[WIP] [Dataflow Streaming] Use separate heartbeat streams based on job settings
[Dataflow Streaming] Use isolated windmill streams based on job settings
Sep 20, 2024
R: @scwhittle |
Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment |
Run Java Precommit |
scwhittle
requested changes
Sep 20, 2024
.../java/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/GrpcDispatcherClient.java
Show resolved
Hide resolved
.../beam/runners/dataflow/worker/windmill/client/grpc/stubs/WindmillStubFactoryFactoryImpl.java
Show resolved
Hide resolved
...ava/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/GrpcWindmillServerTest.java
Outdated
Show resolved
Hide resolved
scwhittle
requested changes
Sep 25, 2024
.../beam/runners/dataflow/worker/windmill/client/grpc/stubs/WindmillStubFactoryFactoryImpl.java
Show resolved
Hide resolved
...a/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/GrpcDispatcherClientTest.java
Show resolved
Hide resolved
...a/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/GrpcDispatcherClientTest.java
Show resolved
Hide resolved
Run Java Precommit |
1 similar comment
Run Java Precommit |
scwhittle
approved these changes
Sep 26, 2024
Failure is unrelated pubsub auth error |
Naireen
pushed a commit
to Naireen/beam
that referenced
this pull request
Sep 26, 2024
[Dataflow Streaming] Use isolated windmill streams based on job settings (apache#32503)
johnjcasey
pushed a commit
that referenced
this pull request
Oct 23, 2024
* Add kafka poll latency metrics * Address Sam's comments [Dataflow Streaming] Use isolated windmill streams based on job settings (#32503) * Add kafka poll latency metrics * address comments * Ensure this is disabled for now until flag to enable it is explicitly passed --------- Co-authored-by: Naireen <naireenhussain@google.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The change is behind an experiment
streaming_engine_use_job_settings_for_isolated_channels
. The experiment will be removed once backend changes are rollback safe.