You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The "manager" component makes a RPC call create_kernels to "agent" components. The manager blocks and waits for the RPC response from agents, which:
Creates tight coupling between managers and agents
Increases latency as managers must wait for kernel creation completion
Proposed Changes
Refactor the create_kernels RPC function to use a fire-and-forget pattern with event-based result handling:
Manager component:
Implement event subscription to receive kernel creation failure (managers are already handling creation success events).
Agent component:
Modify create_kernels RPC handler to spawn background coroutine tasks
Return response in create_kernels RPC function immediately
Add error handling and dispatch kernel creation failure events
The text was updated successfully, but these errors were encountered:
fregataa
changed the title
Let a scheduler create sessions by "fire and forget"
Refactor create_kernels RPC call to asynchronous event-driven pattern
Oct 24, 2024
Current Behavior
The "manager" component makes a RPC call
create_kernels
to "agent" components. The manager blocks and waits for the RPC response from agents, which:Creates tight coupling between managers and agents
Increases latency as managers must wait for kernel creation completion
Proposed Changes
Refactor the
create_kernels
RPC function to use a fire-and-forget pattern with event-based result handling:create_kernels
RPC handler to spawn background coroutine taskscreate_kernels
RPC function immediatelyThe text was updated successfully, but these errors were encountered: