Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

Update parallel tpe #1373

Merged
merged 72 commits into from
Aug 1, 2019
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
72 commits
Select commit Hold shift + click to select a range
20bf28b
update readme in ga_squad
xuehui1991 Sep 20, 2018
14d8f60
update readme
xuehui1991 Sep 20, 2018
d842121
fix typo
xuehui1991 Sep 20, 2018
0d67525
Update README.md
xuehui1991 Sep 20, 2018
b52854a
Update README.md
xuehui1991 Sep 20, 2018
374491d
Update README.md
xuehui1991 Sep 20, 2018
c805d2a
update readme
xuehui1991 Sep 20, 2018
c825d49
Merge branch 'update_ga_squad' of https://github.com/xuehui1991/nni i…
xuehui1991 Sep 20, 2018
6fdde2c
Merge branch 'master' of https://github.com/Microsoft/nni
xuehui1991 Sep 25, 2018
d41a8b0
Merge branch 'master' of https://github.com/Microsoft/nni
xuehui1991 Sep 25, 2018
cc765b8
Merge branch 'master' into update_ga_squad
xuehui1991 Sep 26, 2018
ef5eba8
Merge branch 'update_ga_squad' of https://github.com/xuehui1991/nni i…
xuehui1991 Sep 26, 2018
8ff4508
Merge branch 'xuehui1991-update_ga_squad'
xuehui1991 Sep 26, 2018
629222f
update tuner docs about Anneal
xuehui1991 Dec 4, 2018
ef74ffa
update
xuehui1991 Dec 4, 2018
22b3add
fix path
xuehui1991 Dec 4, 2018
c97fd11
update reference
xuehui1991 Dec 4, 2018
0afbffd
fix bug in config file
xuehui1991 Dec 5, 2018
7022e6e
Merge remote-tracking branch 'upstream/master'
xuehui1991 Dec 14, 2018
770677c
update nni_arch_overview.png
xuehui1991 Dec 14, 2018
e002331
update
xuehui1991 Dec 14, 2018
d066896
update
xuehui1991 Dec 14, 2018
096f69b
update
xuehui1991 Dec 14, 2018
47218a7
Merge remote-tracking branch 'upstream/master'
xuehui1991 Dec 27, 2018
5b84743
Merge remote-tracking branch 'upstream/master'
xuehui1991 Jan 16, 2019
4d989a6
update home page
xuehui1991 Jan 16, 2019
829ff65
Merge remote-tracking branch 'upstream/master'
xuehui1991 Apr 24, 2019
377ddad
update default value of metis tuner
xuehui1991 Apr 24, 2019
93d5d24
Merge remote-tracking branch 'upstream/master'
xuehui1991 May 21, 2019
4465706
fix broken link in CommunitySharings
xuehui1991 May 22, 2019
47308e1
Merge remote-tracking branch 'upstream/master'
xuehui1991 May 28, 2019
2550f5d
update docs about nested search space
xuehui1991 May 28, 2019
71a93e6
update docs
xuehui1991 May 28, 2019
89e13e4
rename cascding to nested
xuehui1991 May 28, 2019
2c9914d
fix broken link
xuehui1991 May 28, 2019
fb721ab
update
xuehui1991 May 28, 2019
593edb7
update issue link
xuehui1991 May 28, 2019
0d3e6b6
fix typo
xuehui1991 May 28, 2019
31309d0
Merge remote-tracking branch 'upstream/master'
xuehui1991 May 28, 2019
0dd7f42
Merge tag 'v0.8'
xuehui1991 Jun 4, 2019
90dfdde
Merge remote-tracking branch 'upstream/master'
xuehui1991 Jun 17, 2019
be72fa4
Merge remote-tracking branch 'upstream/master'
xuehui1991 Jun 24, 2019
216f1f2
update evaluate parameters from GMM
xuehui1991 Jun 24, 2019
d02fdb6
refine code
xuehui1991 Jun 24, 2019
3089e4e
Merge remote-tracking branch 'upstream/master'
xuehui1991 Jun 25, 2019
62a9354
fix optimized mode bug
xuehui1991 Jun 25, 2019
3e1d927
update import warning
xuehui1991 Jun 25, 2019
3606f14
update warning
xuehui1991 Jun 25, 2019
bd1ab20
update optimized mode
xuehui1991 Jun 25, 2019
d194c1d
Merge remote-tracking branch 'upstream/master'
xuehui1991 Jul 10, 2019
a46f764
Merge remote-tracking branch 'upstream/master'
xuehui1991 Jul 12, 2019
ad986e6
fix parallel_tpe bug and refine
xuehui1991 Jul 12, 2019
b4d5529
fix bug
xuehui1991 Jul 12, 2019
8ab8ce7
fix kwargs bug
xuehui1991 Jul 12, 2019
86c5240
fix bug
xuehui1991 Jul 12, 2019
8450bc9
update the default value of parallel_tpe
xuehui1991 Jul 15, 2019
c6176b3
Merge remote-tracking branch 'upstream/master' into parallel_tpe
xuehui1991 Jul 15, 2019
4b2d802
add docs for parallel-tpe
xuehui1991 Jul 15, 2019
830b2b0
fix config_schema bug
xuehui1991 Jul 15, 2019
6cc1055
update community doc
xuehui1991 Jul 15, 2019
c61d3e9
fix typo
xuehui1991 Jul 15, 2019
204fb45
update doc for parallel_tpe
xuehui1991 Jul 17, 2019
36c761f
fix bug in receive trial result
xuehui1991 Jul 17, 2019
a263571
update by comments
xuehui1991 Jul 17, 2019
1509109
update by comments
xuehui1991 Jul 21, 2019
138eea6
fix self.optimal_y is 0 when mean mode
xuehui1991 Jul 26, 2019
57707e5
Merge remote-tracking branch 'upstream/master' into update_parallel_tpe
xuehui1991 Jul 26, 2019
f198bad
update
xuehui1991 Jul 26, 2019
954bea8
update
xuehui1991 Jul 29, 2019
d001eb9
Merge remote-tracking branch 'upstream/master' into update_parallel_tpe
xuehui1991 Aug 1, 2019
8d87a9a
update rst
xuehui1991 Aug 1, 2019
d8153c2
fix typo | add docstring
xuehui1991 Aug 1, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/en_US/CommunitySharings/ParallelizingTpeSearch.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ Here is a simulation of the TPE algorithm in a two-dimensional search space. The

![](../../img/parallel_tpe_search_ei2.PNG)

TPE perfors well when we use it in sequential, but if we provide a larger concurrency, then **there will be a large number of points produced in the same EI state**, too concentrated points will reduce the exploration ability of the tuner, resulting in resources waste.
TPE performs well when we use it in sequential, but if we provide a larger concurrency, then **there will be a large number of points produced in the same EI state**, too concentrated points will reduce the exploration ability of the tuner, resulting in resources waste.

Here is the simulation figure when we set `concurrency=60`, It can be seen that this phenomenon is obvious.

Expand Down
4 changes: 3 additions & 1 deletion src/sdk/pynni/nni/hyperopt_tuner/hyperopt_tuner.py
Original file line number Diff line number Diff line change
Expand Up @@ -198,9 +198,11 @@ def __init__(self, algorithm_name, optimize_mode='minimize',
algorithm_name : str
algorithm_name includes "tpe", "random_search" and anneal".
optimize_mode : str
parallel_optimize : bool
parallel_optimize : bool
More detail could reference: docs/en_US/Tuner/HyperoptTuner.md
xuehui1991 marked this conversation as resolved.
Show resolved Hide resolved
constant_liar_type : str
constant_liar_type including "min", "max" and "mean"
More detail could reference: docs/en_US/Tuner/HyperoptTuner.md
xuehui1991 marked this conversation as resolved.
Show resolved Hide resolved
"""
self.algorithm_name = algorithm_name
self.optimize_mode = OptimizeMode(optimize_mode)
Expand Down