Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

Improve web UI performance for large experiment #1490

Closed
lvybriage opened this issue Aug 26, 2019 · 3 comments
Closed

Improve web UI performance for large experiment #1490

lvybriage opened this issue Aug 26, 2019 · 3 comments
Assignees
@lvybriage @liuzhe-lz
Labels
design discussion enhancement New feature or request nnidev
Milestone
Sept 2019 Release

Comments

@lvybriage
Copy link
Contributor

lvybriage commented Aug 26, 2019 •
edited by liuzhe-lz
Loading

REST Server Side

  • Add API: get latest metric of each trial
  • Add API: get metrics from a list of trials

Web UI Side

  • Maintain a collection of all received metric
  • On loading, request trial metrics by group (maybe 100 trials each time?)
  • For unfinished (WAITING, RUNNING, ...) trials, periodically request metrics and update the collection
  • For finished (SUCCEEDED, FAILED, EARLY_STOPPED, ...) trials, only request metrics once

Open Questions

  • How to show learning curves when there are too many trials
  • How to improve the performance of NNI manager
@lvybriage
Copy link
Contributor Author

webui estimate: 4d

@liuzhe-lz liuzhe-lz changed the title Refactor api Improve web UI performance for large experiment Aug 28, 2019
@liuzhe-lz liuzhe-lz added design discussion enhancement New feature or request labels Aug 28, 2019
@suiguoxin suiguoxin mentioned this issue Aug 28, 2019
Closed
36 tasks
@scarlett2018 scarlett2018 added this to the Sept 2019 Release milestone Sep 2, 2019
@rabbit008
Copy link
Contributor

related #907

@ultmaster ultmaster mentioned this issue Oct 20, 2019
Closed
@lvybriage
Copy link
Contributor Author

related PR: #1557

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@lvybriage lvybriage

@liuzhe-lz liuzhe-lz

Labels
design discussion enhancement New feature or request nnidev
Projects
None yet
Milestone
Sept 2019 Release
Development

No branches or pull requests
4 participants
@rabbit008 @lvybriage @scarlett2018 @liuzhe-lz