-
Notifications
You must be signed in to change notification settings - Fork 139
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Make service runtime short-lived by default #2453
Conversation
edd931e
to
f6fa238
Compare
0e04672
to
fdd5435
Compare
@@ -45,6 +45,14 @@ pub struct ExecutionStateView<C> { | |||
pub users: HashedReentrantCollectionView<C, UserApplicationId, KeyValueStoreView<C>>, | |||
} | |||
|
|||
/// How to interact with a long-lived service runtime. | |||
pub struct ServiceRuntimeEndpoint { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should it be ApplicationServiceEndpoint
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think we could do that 👍
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ok so there are several names to change so this will have to wait another PR
let (committee, worker) = init_worker( | ||
storage, /* is_client */ false, /* has_long_lived_services */ false, | ||
); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Might be a nice place for bon
* Make long lived services optional (and not the default) * fix README of LLM * fix help * fix worker tests * address comments * fix execution tests * update CLI.md
* Make long lived services optional (and not the default) * fix README of LLM * fix help * fix worker tests * address comments * fix execution tests * update CLI.md
Motivation
The long-lived services are somehow experimental and are mostly used for the LLM demo.
Stability issues were solved but we should probably not activate long-lived services by default anyway.
Proposal
Test Plan
Release Plan