Sarah Krebs: Merge branch 'main' of github.com:automl/SMAC3 into deve…

…lopment

development/.buildinfo

@@ -1,4 +1,4 @@
 # Sphinx build info version 1
 # This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
-config: ab7023a151b9d640d093badaacea3061
+config: 2b67c98518f20917c03746a37477b9d6
 tags: 645f666f9bcd5a90fca523b33c5a78b7

development/_sources/examples/1_basics/1_quadratic_function.rst.txt

@@ -167,7 +167,7 @@ be applied to problems with large evaluation budgets (up to 1000 evaluations).
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 0 minutes  2.671 seconds)
+   **Total running time of the script:** ( 0 minutes  2.608 seconds)
 
 
 .. _sphx_glr_download_examples_1_basics_1_quadratic_function.py:

development/_sources/examples/1_basics/2_svm_cv.rst.txt

@@ -151,7 +151,7 @@ types as well as conditional hyperparameters.
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 0 minutes  1.222 seconds)
+   **Total running time of the script:** ( 0 minutes  1.204 seconds)
 
 
 .. _sphx_glr_download_examples_1_basics_2_svm_cv.py:

development/_sources/examples/1_basics/3_ask_and_tell.rst.txt

@@ -158,7 +158,7 @@ This examples show how to use the Ask-and-Tell interface.
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 0 minutes  3.096 seconds)
+   **Total running time of the script:** ( 0 minutes  3.037 seconds)
 
 
 .. _sphx_glr_download_examples_1_basics_3_ask_and_tell.py:

development/_sources/examples/1_basics/4_callback.rst.txt

@@ -144,7 +144,7 @@ Furthermore, we print some stages of the optimization process.
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 0 minutes  0.148 seconds)
+   **Total running time of the script:** ( 0 minutes  0.146 seconds)
 
 
 .. _sphx_glr_download_examples_1_basics_4_callback.py:

development/_sources/examples/1_basics/5_continue.rst.txt

@@ -173,7 +173,7 @@ function is continued. We use a custom callback, to artificially stop the first
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 0 minutes  0.877 seconds)
+   **Total running time of the script:** ( 0 minutes  0.850 seconds)
 
 
 .. _sphx_glr_download_examples_1_basics_5_continue.py:

development/_sources/examples/1_basics/6_priors.rst.txt

@@ -238,7 +238,7 @@ optimization, you have to change the acquisition function to ``PriorAcquisitionF
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 0 minutes  30.302 seconds)
+   **Total running time of the script:** ( 0 minutes  28.927 seconds)
 
 
 .. _sphx_glr_download_examples_1_basics_6_priors.py:

development/_sources/examples/1_basics/sg_execution_times.rst.txt

@@ -6,18 +6,18 @@
 
 Computation times
 =================
-**00:38.315** total execution time for **examples_1_basics** files:
+**00:36.772** total execution time for **examples_1_basics** files:
 
 +-----------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_examples_1_basics_6_priors.py` (``6_priors.py``)                         | 00:30.302 | 0.0 MB |
+| :ref:`sphx_glr_examples_1_basics_6_priors.py` (``6_priors.py``)                         | 00:28.927 | 0.0 MB |
 +-----------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_examples_1_basics_3_ask_and_tell.py` (``3_ask_and_tell.py``)             | 00:03.096 | 0.0 MB |
+| :ref:`sphx_glr_examples_1_basics_3_ask_and_tell.py` (``3_ask_and_tell.py``)             | 00:03.037 | 0.0 MB |
 +-----------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_examples_1_basics_1_quadratic_function.py` (``1_quadratic_function.py``) | 00:02.671 | 0.0 MB |
+| :ref:`sphx_glr_examples_1_basics_1_quadratic_function.py` (``1_quadratic_function.py``) | 00:02.608 | 0.0 MB |
 +-----------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_examples_1_basics_2_svm_cv.py` (``2_svm_cv.py``)                         | 00:01.222 | 0.0 MB |
+| :ref:`sphx_glr_examples_1_basics_2_svm_cv.py` (``2_svm_cv.py``)                         | 00:01.204 | 0.0 MB |
 +-----------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_examples_1_basics_5_continue.py` (``5_continue.py``)                     | 00:00.877 | 0.0 MB |
+| :ref:`sphx_glr_examples_1_basics_5_continue.py` (``5_continue.py``)                     | 00:00.850 | 0.0 MB |
 +-----------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_examples_1_basics_4_callback.py` (``4_callback.py``)                     | 00:00.148 | 0.0 MB |
+| :ref:`sphx_glr_examples_1_basics_4_callback.py` (``4_callback.py``)                     | 00:00.146 | 0.0 MB |
 +-----------------------------------------------------------------------------------------+-----------+--------+

development/_sources/examples/2_multi_fidelity/1_mlp_epochs.rst.txt

@@ -68,34 +68,25 @@ is chosen to optimize the average accuracy on 5-fold cross validation.
     [INFO][smbo.py:319] Finished 0 trials.
     [INFO][smbo.py:319] Finished 50 trials.
     [INFO][abstract_intensifier.py:515] Added config 8ea495 as new incumbent because there are no incumbents yet.
-    [INFO][abstract_intensifier.py:590] Added config 8d6bce and rejected config 8ea495 as incumbent because it is not better than the incumbents on 1 instances:
-    [INFO][configspace.py:175] --- activation: 'tanh' -> 'relu'
-    [INFO][configspace.py:175] --- batch_size: 214 -> 172
-    [INFO][configspace.py:175] --- learning_rate: None -> 'constant'
-    [INFO][configspace.py:175] --- learning_rate_init: 0.005599223654063347 -> 0.01642710176117276
-    [INFO][configspace.py:175] --- n_neurons: 66 -> 59
-    [INFO][configspace.py:175] --- solver: 'adam' -> 'sgd'
-    [INFO][abstract_intensifier.py:590] Added config 2fdad2 and rejected config 8d6bce as incumbent because it is not better than the incumbents on 1 instances:
-    [INFO][configspace.py:175] --- batch_size: 172 -> 120
-    [INFO][configspace.py:175] --- learning_rate_init: 0.01642710176117276 -> 0.016006513675418
-    [INFO][configspace.py:175] --- n_layer: 4 -> 5
-    [INFO][configspace.py:175] --- n_neurons: 59 -> 69
+    [INFO][abstract_intensifier.py:590] Added config 704d44 and rejected config 8ea495 as incumbent because it is not better than the incumbents on 1 instances:
+    [INFO][configspace.py:175] --- activation: 'tanh' -> 'logistic'
+    [INFO][configspace.py:175] --- batch_size: 214 -> 31
+    [INFO][configspace.py:175] --- learning_rate_init: 0.005599223654063347 -> 0.0038549874043245355
+    [INFO][configspace.py:175] --- n_layer: 4 -> 1
+    [INFO][configspace.py:175] --- n_neurons: 66 -> 87
+    [INFO][smbo.py:319] Finished 100 trials.
+    [INFO][smbo.py:319] Finished 100 trials.
     [INFO][smbo.py:327] Configuration budget is exhausted:
-    [INFO][smbo.py:328] --- Remaining wallclock time: -0.1654202938079834
+    [INFO][smbo.py:328] --- Remaining wallclock time: -0.09807491302490234
     [INFO][smbo.py:329] --- Remaining cpu time: inf
-    [INFO][smbo.py:330] --- Remaining trials: 405
-    [INFO][abstract_intensifier.py:590] Added config 1518bd and rejected config 2fdad2 as incumbent because it is not better than the incumbents on 1 instances:
-    [INFO][configspace.py:175] --- batch_size: 120 -> 244
-    [INFO][configspace.py:175] --- learning_rate_init: 0.016006513675418 -> 0.004540507635127548
-    [INFO][configspace.py:175] --- n_layer: 5 -> 4
-    [INFO][configspace.py:175] --- n_neurons: 69 -> 200
+    [INFO][smbo.py:330] --- Remaining trials: 393
     Default cost (SuccessiveHalving): 0.36672856700711853
-    Incumbent cost (SuccessiveHalving): 0.026159083874961353
+    Incumbent cost (SuccessiveHalving): 0.0178087279480037
     [INFO][abstract_initial_design.py:82] Using `n_configs` and ignoring `n_configs_per_hyperparameter`.
     [INFO][abstract_facade.py:198] Workers are reduced to 8.
     /opt/hostedtoolcache/Python/3.10.11/x64/lib/python3.10/site-packages/distributed/node.py:182: UserWarning: Port 8787 is already in use.
     Perhaps you already have a cluster running?
-    Hosting the HTTP server on port 46829 instead
+    Hosting the HTTP server on port 33967 instead
       warnings.warn(
     [INFO][abstract_initial_design.py:147] Using 5 initial design configurations and 0 additional configurations.
     [INFO][successive_halving.py:164] Successive Halving uses budget type BUDGETS with eta 3, min budget 1, and max budget 25.
@@ -115,42 +106,26 @@ is chosen to optimize the average accuracy on 5-fold cross validation.
     [INFO][smbo.py:319] Finished 0 trials.
     [INFO][smbo.py:319] Finished 0 trials.
     [INFO][smbo.py:319] Finished 0 trials.
-    [INFO][abstract_intensifier.py:515] Added config 319164 as new incumbent because there are no incumbents yet.
-    [INFO][abstract_intensifier.py:590] Added config b57404 and rejected config 319164 as incumbent because it is not better than the incumbents on 1 instances:
-    [INFO][configspace.py:175] --- activation: 'relu' -> 'tanh'
-    [INFO][configspace.py:175] --- batch_size: 111 -> 123
-    [INFO][configspace.py:175] --- learning_rate_init: 0.0008670439257692167 -> 0.011991802841520254
-    [INFO][configspace.py:175] --- n_neurons: 79 -> 55
-    [INFO][abstract_intensifier.py:590] Added config b8c2ba and rejected config b57404 as incumbent because it is not better than the incumbents on 1 instances:
-    [INFO][configspace.py:175] --- batch_size: 123 -> 195
-    [INFO][configspace.py:175] --- learning_rate_init: 0.011991802841520254 -> 0.01752914135549273
-    [INFO][configspace.py:175] --- n_neurons: 55 -> 109
-    [INFO][abstract_intensifier.py:590] Added config ad70f9 and rejected config b8c2ba as incumbent because it is not better than the incumbents on 1 instances:
-    [INFO][configspace.py:175] --- activation: 'tanh' -> 'relu'
-    [INFO][configspace.py:175] --- batch_size: 195 -> 233
-    [INFO][configspace.py:175] --- learning_rate_init: 0.01752914135549273 -> 0.01535535683984055
-    [INFO][configspace.py:175] --- n_neurons: 109 -> 197
+    [INFO][abstract_intensifier.py:515] Added config 3e854d as new incumbent because there are no incumbents yet.
+    [INFO][abstract_intensifier.py:590] Added config e27357 and rejected config 3e854d as incumbent because it is not better than the incumbents on 1 instances:
+    [INFO][configspace.py:175] --- activation: 'relu' -> 'logistic'
+    [INFO][configspace.py:175] --- batch_size: None -> 103
+    [INFO][configspace.py:175] --- learning_rate_init: None -> 0.02113934324402315
+    [INFO][configspace.py:175] --- n_layer: 4 -> 1
+    [INFO][configspace.py:175] --- n_neurons: 9 -> 19
+    [INFO][configspace.py:175] --- solver: 'lbfgs' -> 'adam'
+    [INFO][abstract_intensifier.py:590] Added config 704d44 and rejected config e27357 as incumbent because it is not better than the incumbents on 1 instances:
+    [INFO][configspace.py:175] --- batch_size: 103 -> 31
+    [INFO][configspace.py:175] --- learning_rate_init: 0.02113934324402315 -> 0.0038549874043245355
+    [INFO][configspace.py:175] --- n_neurons: 19 -> 87
+    [INFO][smbo.py:319] Finished 50 trials.
     [INFO][smbo.py:319] Finished 50 trials.
     [INFO][smbo.py:327] Configuration budget is exhausted:
-    [INFO][smbo.py:328] --- Remaining wallclock time: -0.3777318000793457
+    [INFO][smbo.py:328] --- Remaining wallclock time: -1.8553111553192139
     [INFO][smbo.py:329] --- Remaining cpu time: inf
-    [INFO][smbo.py:330] --- Remaining trials: 433
-    [INFO][abstract_intensifier.py:590] Added config 7bf909 and rejected config ad70f9 as incumbent because it is not better than the incumbents on 1 instances:
-    [INFO][configspace.py:175] --- activation: 'relu' -> 'tanh'
-    [INFO][configspace.py:175] --- batch_size: 233 -> 254
-    [INFO][configspace.py:175] --- learning_rate_init: 0.01535535683984055 -> 0.024354043306024305
-    [INFO][configspace.py:175] --- n_neurons: 197 -> 245
-    [INFO][configspace.py:175] --- solver: 'sgd' -> 'adam'
-    [INFO][abstract_intensifier.py:590] Added config 035a84 and rejected config 7bf909 as incumbent because it is not better than the incumbents on 1 instances:
-    [INFO][configspace.py:175] --- activation: 'tanh' -> 'relu'
-    [INFO][configspace.py:175] --- batch_size: 254 -> 259
-    [INFO][configspace.py:175] --- learning_rate: None -> 'constant'
-    [INFO][configspace.py:175] --- learning_rate_init: 0.024354043306024305 -> 0.0075638421362735015
-    [INFO][configspace.py:175] --- n_layer: 1 -> 4
-    [INFO][configspace.py:175] --- n_neurons: 245 -> 183
-    [INFO][configspace.py:175] --- solver: 'adam' -> 'sgd'
+    [INFO][smbo.py:330] --- Remaining trials: 416
     Default cost (Hyperband): 0.36672856700711853
-    Incumbent cost (Hyperband): 0.021148251315382338
+    Incumbent cost (Hyperband): 0.0178087279480037
 
 
 
@@ -329,7 +304,7 @@ is chosen to optimize the average accuracy on 5-fold cross validation.
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 2 minutes  46.472 seconds)
+   **Total running time of the script:** ( 2 minutes  30.553 seconds)
 
 
 .. _sphx_glr_download_examples_2_multi_fidelity_1_mlp_epochs.py:

development/_sources/examples/2_multi_fidelity/2_sgd_datasets.rst.txt

@@ -73,10 +73,11 @@ the target function now is required to have an instance argument.
     [INFO][smbo.py:319] Finished 150 trials.
     [INFO][smbo.py:319] Finished 200 trials.
     [INFO][smbo.py:319] Finished 250 trials.
+    [INFO][smbo.py:319] Finished 300 trials.
     [INFO][smbo.py:327] Configuration budget is exhausted:
-    [INFO][smbo.py:328] --- Remaining wallclock time: -0.03758692741394043
+    [INFO][smbo.py:328] --- Remaining wallclock time: -0.029857873916625977
     [INFO][smbo.py:329] --- Remaining cpu time: inf
-    [INFO][smbo.py:330] --- Remaining trials: 4703
+    [INFO][smbo.py:330] --- Remaining trials: 4652
     Default cost: 0.15489347419148672
     Incumbent cost: 0.006249006102246613
 
@@ -218,7 +219,7 @@ the target function now is required to have an instance argument.
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 0 minutes  38.849 seconds)
+   **Total running time of the script:** ( 0 minutes  38.884 seconds)
 
 
 .. _sphx_glr_download_examples_2_multi_fidelity_2_sgd_datasets.py:

development/_sources/examples/2_multi_fidelity/sg_execution_times.rst.txt

@@ -6,10 +6,10 @@
 
 Computation times
 =================
-**03:25.321** total execution time for **examples_2_multi_fidelity** files:
+**03:09.437** total execution time for **examples_2_multi_fidelity** files:
 
 +-------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_examples_2_multi_fidelity_1_mlp_epochs.py` (``1_mlp_epochs.py``)     | 02:46.472 | 0.0 MB |
+| :ref:`sphx_glr_examples_2_multi_fidelity_1_mlp_epochs.py` (``1_mlp_epochs.py``)     | 02:30.553 | 0.0 MB |
 +-------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_examples_2_multi_fidelity_2_sgd_datasets.py` (``2_sgd_datasets.py``) | 00:38.849 | 0.0 MB |
+| :ref:`sphx_glr_examples_2_multi_fidelity_2_sgd_datasets.py` (``2_sgd_datasets.py``) | 00:38.884 | 0.0 MB |
 +-------------------------------------------------------------------------------------+-----------+--------+

development/_sources/examples/3_multi_objective/1_schaffer.rst.txt

@@ -464,7 +464,7 @@ SMAC prioritizes the second objective over the first one.
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 0 minutes  10.477 seconds)
+   **Total running time of the script:** ( 0 minutes  10.250 seconds)
 
 
 .. _sphx_glr_download_examples_3_multi_objective_1_schaffer.py:

development/_sources/examples/3_multi_objective/2_parego.rst.txt

@@ -46,22 +46,30 @@ mean accuracy and run-time of each configuration.
     [INFO][abstract_initial_design.py:147] Using 5 initial design configurations and 0 additional configurations.
     [INFO][abstract_intensifier.py:515] Added config 97ef22 as new incumbent because there are no incumbents yet.
     [INFO][abstract_intensifier.py:598] Config f88a6b is a new incumbent. Total number of incumbents: 2.
-    [INFO][abstract_intensifier.py:598] Config d77b40 is a new incumbent. Total number of incumbents: 3.
-    [INFO][abstract_intensifier.py:598] Config 01cb2f is a new incumbent. Total number of incumbents: 4.
-    [INFO][abstract_intensifier.py:598] Config 96518e is a new incumbent. Total number of incumbents: 5.
+    [INFO][abstract_intensifier.py:598] Config 8e1252 is a new incumbent. Total number of incumbents: 3.
+    [INFO][abstract_intensifier.py:598] Config d77b40 is a new incumbent. Total number of incumbents: 4.
+    [INFO][abstract_intensifier.py:598] Config 0ff715 is a new incumbent. Total number of incumbents: 5.
+    [INFO][abstract_intensifier.py:598] Config 429c43 is a new incumbent. Total number of incumbents: 6.
+    [INFO][abstract_intensifier.py:598] Config 59f5ac is a new incumbent. Total number of incumbents: 7.
+    [INFO][abstract_intensifier.py:590] Added config 53a3b0 and rejected config 59f5ac as incumbent because it is not better than the incumbents on 2 instances:
+    [INFO][configspace.py:175] --- batch_size: 201 -> 211
+    [INFO][configspace.py:175] --- learning_rate_init: 0.0009638957818340346 -> 0.001244415480039115
+    [INFO][configspace.py:175] --- n_neurons: 218 -> 204
     [INFO][smbo.py:327] Configuration budget is exhausted:
-    [INFO][smbo.py:328] --- Remaining wallclock time: -2.045799970626831
+    [INFO][smbo.py:328] --- Remaining wallclock time: -1.2417519092559814
     [INFO][smbo.py:329] --- Remaining cpu time: inf
-    [INFO][smbo.py:330] --- Remaining trials: 182
+    [INFO][smbo.py:330] --- Remaining trials: 180
     Validated costs from default config: 
-    --- [0.60155834 0.25169373]
+    --- [0.60155834 0.22803581]
 
     Validated costs from the Pareto front (incumbents):
-    --- [0.88924791 0.32273936]
-    --- [0.04813757 0.78302634]
-    --- [0.03561281 0.96546268]
-    --- [0.03534045 1.25752056]
-    --- [0.03033581 1.98614478]
+    --- [0.88924791 0.25213516]
+    --- [0.04813757 0.78961754]
+    --- [0.80494274 0.9067992 ]
+    --- [0.03561281 0.96793699]
+    --- [0.0250472  2.23505247]
+    --- [0.02783117 2.16687429]
+    --- [0.02866527 1.80110848]
 
 
 
@@ -242,7 +250,7 @@ mean accuracy and run-time of each configuration.
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 0 minutes  43.379 seconds)
+   **Total running time of the script:** ( 0 minutes  50.206 seconds)
 
 
 .. _sphx_glr_download_examples_3_multi_objective_2_parego.py:

development/_sources/examples/3_multi_objective/sg_execution_times.rst.txt

@@ -6,10 +6,10 @@
 
 Computation times
 =================
-**00:53.856** total execution time for **examples_3_multi_objective** files:
+**01:00.457** total execution time for **examples_3_multi_objective** files:
 
 +------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_examples_3_multi_objective_2_parego.py` (``2_parego.py``)     | 00:43.379 | 0.0 MB |
+| :ref:`sphx_glr_examples_3_multi_objective_2_parego.py` (``2_parego.py``)     | 00:50.206 | 0.0 MB |
 +------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_examples_3_multi_objective_1_schaffer.py` (``1_schaffer.py``) | 00:10.477 | 0.0 MB |
+| :ref:`sphx_glr_examples_3_multi_objective_1_schaffer.py` (``1_schaffer.py``) | 00:10.250 | 0.0 MB |
 +------------------------------------------------------------------------------+-----------+--------+

development/_sources/examples/5_commandline/1_call_target_function_script.rst.txt

@@ -115,7 +115,7 @@ This simple example shows how to call a script with the following content:
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 0 minutes  5.012 seconds)
+   **Total running time of the script:** ( 0 minutes  5.660 seconds)
 
 
 .. _sphx_glr_download_examples_5_commandline_1_call_target_function_script.py:

development/_sources/examples/5_commandline/sg_execution_times.rst.txt

@@ -6,8 +6,8 @@
 
 Computation times
 =================
-**00:05.012** total execution time for **examples_5_commandline** files:
+**00:05.660** total execution time for **examples_5_commandline** files:
 
 +----------------------------------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_examples_5_commandline_1_call_target_function_script.py` (``1_call_target_function_script.py``) | 00:05.012 | 0.0 MB |
+| :ref:`sphx_glr_examples_5_commandline_1_call_target_function_script.py` (``1_call_target_function_script.py``) | 00:05.660 | 0.0 MB |
 +----------------------------------------------------------------------------------------------------------------+-----------+--------+