Skip to content

Commit

Permalink
Aron Bahram: fix(runhistory): set id of the sampled config (#951)
Browse files Browse the repository at this point in the history
  • Loading branch information
Github Actions committed Mar 23, 2023
1 parent f7ee70b commit 0f64ba7
Show file tree
Hide file tree
Showing 149 changed files with 974 additions and 834 deletions.
2 changes: 1 addition & 1 deletion development/.buildinfo
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
config: baa8731bc411cbb3fd7c5c44ef246be6
config: d27b9dca29b595f3d2d808c7d6245479
tags: 645f666f9bcd5a90fca523b33c5a78b7
Binary file modified development/.doctrees/environment.pickle
Binary file not shown.
Binary file not shown.
Binary file modified development/.doctrees/examples/1_basics/2_svm_cv.doctree
Binary file not shown.
Binary file modified development/.doctrees/examples/1_basics/3_ask_and_tell.doctree
Binary file not shown.
Binary file modified development/.doctrees/examples/1_basics/4_callback.doctree
Binary file not shown.
Binary file modified development/.doctrees/examples/1_basics/5_continue.doctree
Binary file not shown.
Binary file modified development/.doctrees/examples/1_basics/6_priors.doctree
Binary file not shown.
Binary file modified development/.doctrees/examples/1_basics/index.doctree
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified development/.doctrees/examples/2_multi_fidelity/index.doctree
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified development/.doctrees/examples/3_multi_objective/index.doctree
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified development/.doctrees/examples/5_commandline/index.doctree
Binary file not shown.
Binary file not shown.
Binary file modified development/.doctrees/examples/index.doctree
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file modified development/_images/sphx_glr_1_mlp_epochs_001.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified development/_images/sphx_glr_1_mlp_epochs_thumb.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified development/_images/sphx_glr_1_quadratic_function_001.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified development/_images/sphx_glr_1_schaffer_001.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified development/_images/sphx_glr_1_schaffer_thumb.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified development/_images/sphx_glr_2_parego_001.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified development/_images/sphx_glr_2_parego_thumb.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions development/_modules/smac/runhistory/runhistory.html
Original file line number Diff line number Diff line change
Expand Up @@ -1208,6 +1208,9 @@ <h1>Source code for smac.runhistory.runhistory</h1><div class="highlight"><pre>

<span class="n">config_id</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">_n_id</span>

<span class="c1"># Set the id attribute of the config object, so that users can access it</span>
<span class="n">config</span><span class="o">.</span><span class="n">config_id</span> <span class="o">=</span> <span class="n">config_id</span>

<span class="k">if</span> <span class="n">status</span> <span class="o">!=</span> <span class="n">StatusType</span><span class="o">.</span><span class="n">RUNNING</span><span class="p">:</span>
<span class="k">if</span> <span class="bp">self</span><span class="o">.</span><span class="n">_n_objectives</span> <span class="o">==</span> <span class="o">-</span><span class="mi">1</span><span class="p">:</span>
<span class="bp">self</span><span class="o">.</span><span class="n">_n_objectives</span> <span class="o">=</span> <span class="n">n_objectives</span>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
.. note::
:class: sphx-glr-download-link-note

Click :ref:`here <sphx_glr_download_examples_1_basics_1_quadratic_function.py>`
:ref:`Go to the end <sphx_glr_download_examples_1_basics_1_quadratic_function.py>`
to download the full example code

.. rst-class:: sphx-glr-example-title
Expand Down Expand Up @@ -167,7 +167,7 @@ be applied to problems with large evaluation budgets (up to 1000 evaluations).
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 0 minutes 4.298 seconds)
**Total running time of the script:** ( 0 minutes 3.106 seconds)


.. _sphx_glr_download_examples_1_basics_1_quadratic_function.py:
Expand All @@ -177,6 +177,8 @@ be applied to problems with large evaluation budgets (up to 1000 evaluations).
.. container:: sphx-glr-footer sphx-glr-footer-example




.. container:: sphx-glr-download sphx-glr-download-python

:download:`Download Python source code: 1_quadratic_function.py <1_quadratic_function.py>`
Expand Down
6 changes: 4 additions & 2 deletions development/_sources/examples/1_basics/2_svm_cv.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
.. note::
:class: sphx-glr-download-link-note

Click :ref:`here <sphx_glr_download_examples_1_basics_2_svm_cv.py>`
:ref:`Go to the end <sphx_glr_download_examples_1_basics_2_svm_cv.py>`
to download the full example code

.. rst-class:: sphx-glr-example-title
Expand Down Expand Up @@ -151,7 +151,7 @@ types as well as conditional hyperparameters.
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 0 minutes 1.818 seconds)
**Total running time of the script:** ( 0 minutes 1.428 seconds)


.. _sphx_glr_download_examples_1_basics_2_svm_cv.py:
Expand All @@ -161,6 +161,8 @@ types as well as conditional hyperparameters.
.. container:: sphx-glr-footer sphx-glr-footer-example




.. container:: sphx-glr-download sphx-glr-download-python

:download:`Download Python source code: 2_svm_cv.py <2_svm_cv.py>`
Expand Down
44 changes: 26 additions & 18 deletions development/_sources/examples/1_basics/3_ask_and_tell.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
.. note::
:class: sphx-glr-download-link-note

Click :ref:`here <sphx_glr_download_examples_1_basics_3_ask_and_tell.py>`
:ref:`Go to the end <sphx_glr_download_examples_1_basics_3_ask_and_tell.py>`
to download the full example code

.. rst-class:: sphx-glr-example-title
Expand Down Expand Up @@ -40,29 +40,35 @@ This examples show how to use the Ask-and-Tell interface.
[INFO][abstract_intensifier.py:588] Added config 94b2fe and rejected config 94dccd as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 0.03135360777378082 -> 1.8422549832482282
[INFO][configspace.py:175] --- x1: -0.21179260686039925 -> 3.526509233029728
[INFO][abstract_intensifier.py:588] Added config a4c09f and rejected config 94b2fe as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 1.8422549832482282 -> 1.980770819590341
[INFO][configspace.py:175] --- x1: 3.526509233029728 -> 4.03432249924802
[INFO][abstract_intensifier.py:588] Added config 026b73 and rejected config 94b2fe as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 1.8422549832482282 -> 0.10203668300079549
[INFO][configspace.py:175] --- x1: 3.526509233029728 -> 0.1151862278387501
[INFO][abstract_intensifier.py:588] Added config 5db1de and rejected config 026b73 as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 0.10203668300079549 -> 0.10138875906166067
[INFO][configspace.py:175] --- x1: 0.1151862278387501 -> 0.10325090860241648
[INFO][abstract_intensifier.py:588] Added config c89070 and rejected config 5db1de as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 0.10138875906166067 -> 0.08653325483166885
[INFO][configspace.py:175] --- x1: 0.10325090860241648 -> 0.08549815086526724
[INFO][smbo.py:298] Finished 50 trials.
[INFO][abstract_intensifier.py:588] Added config 3cde7a and rejected config a4c09f as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 1.980770819590341 -> 2.05576260053446
[INFO][configspace.py:175] --- x1: 4.03432249924802 -> 4.189734587316279
[INFO][abstract_intensifier.py:588] Added config e7c1a8 and rejected config 3cde7a as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 2.05576260053446 -> 2.056514790777225
[INFO][configspace.py:175] --- x1: 4.189734587316279 -> 4.2444281430933675
[INFO][abstract_intensifier.py:588] Added config 7ab1b1 and rejected config e7c1a8 as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 2.056514790777225 -> 2.057439307959182
[INFO][configspace.py:175] --- x1: 4.2444281430933675 -> 4.219978780196948
[INFO][abstract_intensifier.py:588] Added config 75934b and rejected config 7ab1b1 as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 2.057439307959182 -> 2.0561106976838825
[INFO][configspace.py:175] --- x1: 4.219978780196948 -> 4.233093984919787
[INFO][abstract_intensifier.py:588] Added config f3174e and rejected config c89070 as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 0.08653325483166885 -> 0.05367820946404134
[INFO][configspace.py:175] --- x1: 0.08549815086526724 -> 0.07009655254860192
[INFO][abstract_intensifier.py:588] Added config 458538 and rejected config f3174e as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 0.05367820946404134 -> 0.08292029094844988
[INFO][configspace.py:175] --- x1: 0.07009655254860192 -> 0.06495875484764024
[INFO][abstract_intensifier.py:588] Added config d95598 and rejected config 458538 as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 0.08292029094844988 -> 0.08393076270018529
[INFO][configspace.py:175] --- x1: 0.06495875484764024 -> 0.034451435520161944
[INFO][abstract_intensifier.py:588] Added config 2b7962 and rejected config d95598 as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- x0: 0.08393076270018529 -> 0.07805927091208886
[INFO][configspace.py:175] --- x1: 0.034451435520161944 -> 0.0059357711510132916
[INFO][smbo.py:298] Finished 100 trials.
[INFO][smbo.py:306] Configuration budget is exhausted:
[INFO][smbo.py:307] --- Remaining wallclock time: inf
[INFO][smbo.py:308] --- Remaining cpu time: inf
[INFO][smbo.py:309] --- Remaining trials: 0
Default cost: 16916.0
Incumbent cost: 1.1183978687059386
Incumbent cost: 0.8499771879028607
Expand Down Expand Up @@ -152,7 +158,7 @@ This examples show how to use the Ask-and-Tell interface.
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 0 minutes 4.525 seconds)
**Total running time of the script:** ( 0 minutes 3.605 seconds)


.. _sphx_glr_download_examples_1_basics_3_ask_and_tell.py:
Expand All @@ -162,6 +168,8 @@ This examples show how to use the Ask-and-Tell interface.
.. container:: sphx-glr-footer sphx-glr-footer-example




.. container:: sphx-glr-download sphx-glr-download-python

:download:`Download Python source code: 3_ask_and_tell.py <3_ask_and_tell.py>`
Expand Down
6 changes: 4 additions & 2 deletions development/_sources/examples/1_basics/4_callback.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
.. note::
:class: sphx-glr-download-link-note

Click :ref:`here <sphx_glr_download_examples_1_basics_4_callback.py>`
:ref:`Go to the end <sphx_glr_download_examples_1_basics_4_callback.py>`
to download the full example code

.. rst-class:: sphx-glr-example-title
Expand Down Expand Up @@ -144,7 +144,7 @@ Furthermore, we print some stages of the optimization process.
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 0 minutes 0.202 seconds)
**Total running time of the script:** ( 0 minutes 0.170 seconds)


.. _sphx_glr_download_examples_1_basics_4_callback.py:
Expand All @@ -154,6 +154,8 @@ Furthermore, we print some stages of the optimization process.
.. container:: sphx-glr-footer sphx-glr-footer-example




.. container:: sphx-glr-download sphx-glr-download-python

:download:`Download Python source code: 4_callback.py <4_callback.py>`
Expand Down
6 changes: 4 additions & 2 deletions development/_sources/examples/1_basics/5_continue.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
.. note::
:class: sphx-glr-download-link-note

Click :ref:`here <sphx_glr_download_examples_1_basics_5_continue.py>`
:ref:`Go to the end <sphx_glr_download_examples_1_basics_5_continue.py>`
to download the full example code

.. rst-class:: sphx-glr-example-title
Expand Down Expand Up @@ -173,7 +173,7 @@ function is continued. We use a custom callback, to artificially stop the first
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 0 minutes 1.358 seconds)
**Total running time of the script:** ( 0 minutes 1.025 seconds)


.. _sphx_glr_download_examples_1_basics_5_continue.py:
Expand All @@ -183,6 +183,8 @@ function is continued. We use a custom callback, to artificially stop the first
.. container:: sphx-glr-footer sphx-glr-footer-example




.. container:: sphx-glr-download sphx-glr-download-python

:download:`Download Python source code: 5_continue.py <5_continue.py>`
Expand Down
25 changes: 13 additions & 12 deletions development/_sources/examples/1_basics/6_priors.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
.. note::
:class: sphx-glr-download-link-note

Click :ref:`here <sphx_glr_download_examples_1_basics_6_priors.py>`
:ref:`Go to the end <sphx_glr_download_examples_1_basics_6_priors.py>`
to download the full example code

.. rst-class:: sphx-glr-example-title
Expand Down Expand Up @@ -48,23 +48,22 @@ optimization, you have to change the acquisition function to ``PriorAcquisitionF
[INFO][configspace.py:175] --- n_layer: 2 -> 3
[INFO][configspace.py:175] --- n_neurons: 157 -> 108
[INFO][configspace.py:175] --- optimizer: 'sgd' -> 'adam'
[INFO][abstract_intensifier.py:588] Added config 9d6edf and rejected config 34b1eb as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- batch_size: 128 -> 48
[INFO][configspace.py:175] --- learning_rate_init: 0.0010000000000000002 -> 0.0008561309336666343
[INFO][abstract_intensifier.py:588] Added config 34ee2a and rejected config 34b1eb as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- batch_size: 128 -> 83
[INFO][configspace.py:175] --- n_layer: 3 -> 4
[INFO][configspace.py:175] --- n_neurons: 108 -> 107
[INFO][abstract_intensifier.py:588] Added config f444e1 and rejected config 9d6edf as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- batch_size: 48 -> 78
[INFO][configspace.py:175] --- learning_rate_init: 0.0008561309336666343 -> 0.006128780165374783
[INFO][abstract_intensifier.py:588] Added config 066046 and rejected config 34ee2a as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- batch_size: 83 -> 71
[INFO][configspace.py:175] --- n_layer: 4 -> 3
[INFO][abstract_intensifier.py:588] Added config c0b873 and rejected config f444e1 as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- batch_size: 78 -> 77
[INFO][abstract_intensifier.py:588] Added config 7424fb and rejected config 066046 as incumbent because it is not better than the incumbents on 1 instances:
[INFO][configspace.py:175] --- batch_size: 71 -> 27
[INFO][configspace.py:175] --- n_layer: 3 -> 4
[INFO][configspace.py:175] --- n_neurons: 108 -> 105
[INFO][smbo.py:306] Configuration budget is exhausted:
[INFO][smbo.py:307] --- Remaining wallclock time: inf
[INFO][smbo.py:308] --- Remaining cpu time: inf
[INFO][smbo.py:309] --- Remaining trials: 0
Default cost: 0.038952336737852145
Default cost: 0.02727174249458364
Default cost: 0.026719281956050667
Expand Down Expand Up @@ -239,7 +238,7 @@ optimization, you have to change the acquisition function to ``PriorAcquisitionF
.. rst-class:: sphx-glr-timing

**Total running time of the script:** ( 0 minutes 40.303 seconds)
**Total running time of the script:** ( 0 minutes 34.428 seconds)


.. _sphx_glr_download_examples_1_basics_6_priors.py:
Expand All @@ -249,6 +248,8 @@ optimization, you have to change the acquisition function to ``PriorAcquisitionF
.. container:: sphx-glr-footer sphx-glr-footer-example




.. container:: sphx-glr-download sphx-glr-download-python

:download:`Download Python source code: 6_priors.py <6_priors.py>`
Expand Down
12 changes: 6 additions & 6 deletions development/_sources/examples/1_basics/index.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ Basics
.. only:: html

.. image:: /examples/1_basics/images/thumb/sphx_glr_1_quadratic_function_thumb.png
:alt: Quadratic Function
:alt:

:ref:`sphx_glr_examples_1_basics_1_quadratic_function.py`

Expand All @@ -35,7 +35,7 @@ Basics
.. only:: html

.. image:: /examples/1_basics/images/thumb/sphx_glr_2_svm_cv_thumb.png
:alt: Support Vector Machine with Cross-Validation
:alt:

:ref:`sphx_glr_examples_1_basics_2_svm_cv.py`

Expand All @@ -52,7 +52,7 @@ Basics
.. only:: html

.. image:: /examples/1_basics/images/thumb/sphx_glr_3_ask_and_tell_thumb.png
:alt: Ask-and-Tell
:alt:

:ref:`sphx_glr_examples_1_basics_3_ask_and_tell.py`

Expand All @@ -69,7 +69,7 @@ Basics
.. only:: html

.. image:: /examples/1_basics/images/thumb/sphx_glr_4_callback_thumb.png
:alt: Custom Callback
:alt:

:ref:`sphx_glr_examples_1_basics_4_callback.py`

Expand All @@ -86,7 +86,7 @@ Basics
.. only:: html

.. image:: /examples/1_basics/images/thumb/sphx_glr_5_continue_thumb.png
:alt: Continue an Optimization
:alt:

:ref:`sphx_glr_examples_1_basics_5_continue.py`

Expand All @@ -103,7 +103,7 @@ Basics
.. only:: html

.. image:: /examples/1_basics/images/thumb/sphx_glr_6_priors_thumb.png
:alt: User Priors over the Optimum
:alt:

:ref:`sphx_glr_examples_1_basics_6_priors.py`

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -3,20 +3,21 @@

.. _sphx_glr_examples_1_basics_sg_execution_times:


Computation times
=================
**00:52.504** total execution time for **examples_1_basics** files:
**00:43.762** total execution time for **examples_1_basics** files:

+-----------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_examples_1_basics_6_priors.py` (``6_priors.py``) | 00:40.303 | 0.0 MB |
| :ref:`sphx_glr_examples_1_basics_6_priors.py` (``6_priors.py``) | 00:34.428 | 0.0 MB |
+-----------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_examples_1_basics_3_ask_and_tell.py` (``3_ask_and_tell.py``) | 00:04.525 | 0.0 MB |
| :ref:`sphx_glr_examples_1_basics_3_ask_and_tell.py` (``3_ask_and_tell.py``) | 00:03.605 | 0.0 MB |
+-----------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_examples_1_basics_1_quadratic_function.py` (``1_quadratic_function.py``) | 00:04.298 | 0.0 MB |
| :ref:`sphx_glr_examples_1_basics_1_quadratic_function.py` (``1_quadratic_function.py``) | 00:03.106 | 0.0 MB |
+-----------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_examples_1_basics_2_svm_cv.py` (``2_svm_cv.py``) | 00:01.818 | 0.0 MB |
| :ref:`sphx_glr_examples_1_basics_2_svm_cv.py` (``2_svm_cv.py``) | 00:01.428 | 0.0 MB |
+-----------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_examples_1_basics_5_continue.py` (``5_continue.py``) | 00:01.358 | 0.0 MB |
| :ref:`sphx_glr_examples_1_basics_5_continue.py` (``5_continue.py``) | 00:01.025 | 0.0 MB |
+-----------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_examples_1_basics_4_callback.py` (``4_callback.py``) | 00:00.202 | 0.0 MB |
| :ref:`sphx_glr_examples_1_basics_4_callback.py` (``4_callback.py``) | 00:00.170 | 0.0 MB |
+-----------------------------------------------------------------------------------------+-----------+--------+
Loading

0 comments on commit 0f64ba7

Please sign in to comment.