Skip to content

SRV_server's accuracy higher than SRV_server_best #218

Closed Answered by holgerroth
WeiJongYang asked this question in Q&A
Discussion options

You must be logged in to vote

The "best" global model is chosen based on the average validation scores from each client. This score is computed before each local training to when the client receives the current global model. This means also we can only select the best global model of the previous round using [InTimeModelSelectionHandler](https://github.com/NVIDIA/NVFlare/blob/main/nvflare/app_common/handlers/intime_model_selection_handler.py) after the client sends their model updates and scores of the previous global model. Therefore, it could be that your training is still converging and the final global model (SRV_server) is better than the selected best model (SRV_server_best).

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@WeiJongYang
Comment options

Answer selected by WeiJongYang
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants