Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Dataflow Streaming] Use isolated windmill streams based on job settings #32503

Merged
merged 3 commits into from
Sep 26, 2024

Conversation

arunpandianp
Copy link
Contributor

@arunpandianp arunpandianp commented Sep 19, 2024

The change is behind an experiment streaming_engine_use_job_settings_for_isolated_channels. The experiment will be removed once backend changes are rollback safe.

@arunpandianp arunpandianp changed the title [WIP] [Dataflow Streaming] Use separate heartbeat streams based on job settings [Dataflow Streaming] Use isolated windmill streams based on job settings Sep 20, 2024
@arunpandianp arunpandianp marked this pull request as ready for review September 20, 2024 05:30
@arunpandianp
Copy link
Contributor Author

R: @scwhittle

Copy link
Contributor

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment assign set of reviewers

@arunpandianp
Copy link
Contributor Author

Run Java Precommit

@arunpandianp
Copy link
Contributor Author

Run Java Precommit

1 similar comment
@arunpandianp
Copy link
Contributor Author

Run Java Precommit

@scwhittle
Copy link
Contributor

Failure is unrelated pubsub auth error

@scwhittle scwhittle merged commit 8e8c914 into apache:master Sep 26, 2024
15 of 17 checks passed
Naireen pushed a commit to Naireen/beam that referenced this pull request Sep 26, 2024
[Dataflow Streaming] Use isolated windmill streams based on job settings (apache#32503)
johnjcasey pushed a commit that referenced this pull request Oct 23, 2024
* Add kafka poll latency metrics

* Address Sam's comments

[Dataflow Streaming] Use isolated windmill streams based on job settings (#32503)

* Add kafka poll latency metrics

* address comments

* Ensure this is disabled for now until flag to enable it is explicitly
passed

---------

Co-authored-by: Naireen <naireenhussain@google.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants