Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tools to estimate resource requirements #71

Open
ablaom opened this issue Feb 5, 2019 · 2 comments
Open

Add tools to estimate resource requirements #71

ablaom opened this issue Feb 5, 2019 · 2 comments
Labels
enhancement New feature or request

Comments

@ablaom
Copy link
Member

ablaom commented Feb 5, 2019

No description provided.

@ablaom ablaom added the enhancement New feature or request label Feb 5, 2019
@jpsamaroo
Copy link
Collaborator

I'll have a use for estimating resource needs in the future (for use as an objective variable in some multi-objective optimization problem, and also for preventing my Julia workers from strangling themselves). What ideas do you have in mind for making such estimates?

I could imagine moving averages over the results of @elapsed and @allocated would work well if you're already running a machine multiple times. However, it would be beneficial to also have a rough estimate available before the first run, especially if we consider using huge, automatically-generated Flux models which may be too large to run on any available worker (my usecase).

@ablaom
Copy link
Member Author

ablaom commented Jun 5, 2019

These sound like good the ideas. I think there was also the idea of mapping out resource demands as more and more data rows are made available to the learning algorithm. I think MLR does something like this and calls it "learning curves".

In this regard there may be some overlap with API design for dealing with online/active learning, which I think going to be some work. Some discussion around this is at #139 (comment), with an open issue at #60. Sorry, nonsense, since each time you grow the data you retrain from scratch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants