Running a Multi Objective Optimization Directly in Python#
This notebook demonstrates how to:
Write a basic Wrapper in Python and launch a multi objective optimization from Python. If you wanted to launch it from command line, you would do a similar thing of defining the Wrapper, and then put in your configuration file the information about where the wrapper is, and use BOA’s CLI tools. See Running an Experiment from Command Line (Python Wrapper) for more information.
1import pathlib
2import shutil
3
4from IPython.display import Code
5
6import boa
7from boa.scripts.moo import Wrapper
[WARNING 08-09 18:47:42] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Show code cell content
1# Remove old runs to have a clean slate for this example
2old_runs = pathlib.Path().resolve().glob("moo_run*")
3for path in old_runs:
4 shutil.rmtree(path, ignore_errors=True)
Loading the MOO Config File#
1config_path = pathlib.Path().resolve().parent.parent / "boa/scripts/moo.yaml"
Here we can see what the configuration file looks like
1Code(config_path)
# MultiObjective Optimization config
optimization_options:
objective_options:
objective_thresholds:
- branin >= -18.0
- currin >= -6.0
objectives:
- name: branin
lower_is_better: False
noise_sd: 0
- name: currin
lower_is_better: False
noise_sd: 0
experiment:
name: "moo_run"
trials: 50
parameters:
x0:
type: range
bounds: [0, 1]
value_type: float
x1:
type: range
bounds: [0, 1]
value_type: float
1config = boa.load_jsonlike(config_path)
The Wrapper#
We define our wrapper in wrapper.py and use a synthetic function that stands in for any black box model call
1Code(Wrapper.path())
from pathlib import Path
import torch
from boa.controller import Controller
from boa.metrics.synthetic_funcs import get_synth_func
from boa.utils import torch_device
from boa.wrappers.base_wrapper import BaseWrapper
tkwargs = {
"device": torch_device(),
}
Problem = get_synth_func("BraninCurrin")
problem = Problem(negate=True).to(**tkwargs)
class Wrapper(BaseWrapper):
def run_model(self, trial) -> None:
pass
def set_trial_status(self, trial) -> None:
trial.mark_completed()
def fetch_trial_data(self, trial, metric_properties, metric_name, *args, **kwargs):
evaluation = problem(torch.tensor([trial.arm.parameters["x0"], trial.arm.parameters["x1"]]))
a = float(evaluation[0])
b = float(evaluation[1])
return {"branin": a, "currin": b}
def main():
config_path = Path(__file__).resolve().parent / "moo.yaml"
wrapper = Wrapper(config_path=config_path)
controller = Controller(wrapper=wrapper)
controller.initialize_scheduler()
return controller.run()
if __name__ == "__main__":
main()
The Setup#
1controller = boa.Controller(config_path=config_path, wrapper=Wrapper)
2
3controller.initialize_scheduler()
[INFO 08-09 18:47:43] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x0', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[]).
[INFO 08-09 18:47:43] ax.modelbridge.dispatch_utils: Using Models.MOO since there are more ordered parameters than there are categories for the unordered categorical parameters.
[INFO 08-09 18:47:43] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=2 num_trials=None use_batch_trials=False
[INFO 08-09 18:47:43] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=5
[INFO 08-09 18:47:43] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=5
[INFO 08-09 18:47:43] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+MOO', steps=[Sobol for 5 trials, MOO for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.
[INFO 08-09 18:47:43] Scheduler: `Scheduler` requires experiment to have immutable search space and optimization config. Setting property immutable_search_space_and_opt_config to `True` on experiment.
(Scheduler(experiment=Experiment(moo_run), generation_strategy=GenerationStrategy(name='Sobol+MOO', steps=[Sobol for 5 trials, MOO for subsequent trials]), options=SchedulerOptions(max_pending_trials=10, trial_type=<TrialType.TRIAL: 0>, batch_size=None, total_trials=None, tolerated_trial_failure_rate=0.5, min_failed_trials_for_failure_rate_check=5, log_filepath=None, logging_level=20, ttl_seconds_for_trials=None, init_seconds_between_polls=1, min_seconds_before_poll=1.0, seconds_between_polls_backoff_factor=1.5, timeout_hours=None, run_trials_in_batches=False, debug_log_run_metadata=False, early_stopping_strategy=None, global_stopping_strategy=None, suppress_storage_errors_after_retries=False)),
<boa.scripts.moo.Wrapper at 0x7f99d7742590>)
Start our Experiment#
The Controller will save our scheduler to JSON after it completes the run so we can reload it at a later time for analysis or to resume our experiment
1scheduler = controller.run()
[INFO 2023-08-09 18:47:43,453 MainProcess] boa:
##############################################
BOA Experiment Run
Output Experiment Dir: /home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743
Start Time: 20230809T184743
Version: 0.8.8.dev0+gd6e453f.d20230809
##############################################
[INFO 08-09 18:47:43] Scheduler: Running trials [0]...
[INFO 08-09 18:47:44] Scheduler: Running trials [1]...
[INFO 08-09 18:47:45] Scheduler: Running trials [2]...
[INFO 08-09 18:47:46] Scheduler: Running trials [3]...
[INFO 08-09 18:47:47] Scheduler: Running trials [4]...
[INFO 08-09 18:47:48] Scheduler: Generated all trials that can be generated currently. Model requires more data to generate more trials.
[INFO 08-09 18:47:48] Scheduler: Retrieved COMPLETED trials: 0 - 4.
[INFO 08-09 18:47:48] Scheduler: Fetching data for trials: 0 - 4.
[ERROR 2023-08-09 18:47:48,578 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:47:48,589 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:47:48,612 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:47:48,708 MainProcess] boa: Trials so far: 5
Running trials:
Will Produce next trials from generation step: Sobol
Best trial so far: {}
[INFO 08-09 18:47:49] Scheduler: Running trials [5]...
[INFO 08-09 18:47:50] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:47:50] Scheduler: Running trials [6]...
[INFO 08-09 18:47:52] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:47:52] Scheduler: Running trials [7]...
[INFO 08-09 18:47:53] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:47:53] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:47:53] Scheduler: Retrieved COMPLETED trials: 5 - 7.
[INFO 08-09 18:47:53] Scheduler: Fetching data for trials: 5 - 7.
[ERROR 2023-08-09 18:47:53,930 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:47:53,946 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:47:53,967 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:47:54,045 MainProcess] boa: Trials so far: 8
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045}}
[INFO 08-09 18:47:54] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:47:54] Scheduler: Running trials [8]...
[INFO 08-09 18:47:55] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:47:55] Scheduler: Running trials [9]...
[INFO 08-09 18:47:56] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:47:57] Scheduler: Running trials [10]...
[INFO 08-09 18:47:58] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:47:58] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:47:58] Scheduler: Retrieved COMPLETED trials: 8 - 10.
[INFO 08-09 18:47:58] Scheduler: Fetching data for trials: 8 - 10.
[ERROR 2023-08-09 18:47:58,470 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:47:58,491 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:47:58,512 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:47:58,579 MainProcess] boa: Trials so far: 11
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
8: {'branin': -14.174683570861816, 'currin': -5.179994583129883}}
[INFO 08-09 18:47:58] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:47:59] Scheduler: Running trials [11]...
[INFO 08-09 18:48:00] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:01] Scheduler: Running trials [12]...
[INFO 08-09 18:48:02] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:03] Scheduler: Running trials [13]...
[INFO 08-09 18:48:04] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:04] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:48:04] Scheduler: Retrieved COMPLETED trials: 11 - 13.
[INFO 08-09 18:48:04] Scheduler: Fetching data for trials: 11 - 13.
[ERROR 2023-08-09 18:48:04,860 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:48:04,886 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:48:04,908 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:48:05,007 MainProcess] boa: Trials so far: 14
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004}}
[INFO 08-09 18:48:05] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:06] Scheduler: Running trials [14]...
[INFO 08-09 18:48:06] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:07] Scheduler: Running trials [15]...
[INFO 08-09 18:48:08] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:10] Scheduler: Running trials [16]...
[INFO 08-09 18:48:11] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:11] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:48:11] Scheduler: Retrieved COMPLETED trials: 14 - 16.
[INFO 08-09 18:48:11] Scheduler: Fetching data for trials: 14 - 16.
[ERROR 2023-08-09 18:48:11,423 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:48:11,453 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:48:11,475 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:48:11,603 MainProcess] boa: Trials so far: 17
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463}}
[INFO 08-09 18:48:11] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:12] Scheduler: Running trials [17]...
[INFO 08-09 18:48:13] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:15] Scheduler: Running trials [18]...
[INFO 08-09 18:48:16] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:18] Scheduler: Running trials [19]...
[INFO 08-09 18:48:19] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:19] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:48:19] Scheduler: Retrieved COMPLETED trials: 17 - 19.
[INFO 08-09 18:48:19] Scheduler: Fetching data for trials: 17 - 19.
[ERROR 2023-08-09 18:48:19,363 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:48:19,399 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:48:19,422 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:48:19,569 MainProcess] boa: Trials so far: 20
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686}}
[INFO 08-09 18:48:19] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:21] Scheduler: Running trials [20]...
[INFO 08-09 18:48:22] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:23] Scheduler: Running trials [21]...
[INFO 08-09 18:48:24] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:26] Scheduler: Running trials [22]...
[INFO 08-09 18:48:27] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:27] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:48:27] Scheduler: Retrieved COMPLETED trials: 20 - 22.
[INFO 08-09 18:48:27] Scheduler: Fetching data for trials: 20 - 22.
[ERROR 2023-08-09 18:48:27,857 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:48:27,897 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:48:27,920 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:48:28,067 MainProcess] boa: Trials so far: 23
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
20: {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
21: {'branin': -5.821328163146973, 'currin': -3.086317539215088},
22: {'branin': -8.420209884643555, 'currin': -2.5384483337402344}}
[INFO 08-09 18:48:28] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:28] Scheduler: Running trials [23]...
[INFO 08-09 18:48:29] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:30] Scheduler: Running trials [24]...
[INFO 08-09 18:48:31] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:32] Scheduler: Running trials [25]...
[INFO 08-09 18:48:33] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:33] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:48:33] Scheduler: Retrieved COMPLETED trials: 23 - 25.
[INFO 08-09 18:48:33] Scheduler: Fetching data for trials: 23 - 25.
[ERROR 2023-08-09 18:48:33,762 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:48:33,807 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:48:33,833 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:48:33,999 MainProcess] boa: Trials so far: 26
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
20: {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
21: {'branin': -5.821328163146973, 'currin': -3.086317539215088},
22: {'branin': -8.420209884643555, 'currin': -2.5384483337402344},
25: {'branin': -0.5703239440917969, 'currin': -5.411530017852783}}
[INFO 08-09 18:48:34] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:34] Scheduler: Running trials [26]...
[INFO 08-09 18:48:35] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:36] Scheduler: Running trials [27]...
[INFO 08-09 18:48:37] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:38] Scheduler: Running trials [28]...
[INFO 08-09 18:48:39] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:39] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:48:39] Scheduler: Retrieved COMPLETED trials: 26 - 28.
[INFO 08-09 18:48:39] Scheduler: Fetching data for trials: 26 - 28.
[ERROR 2023-08-09 18:48:39,964 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:48:40,014 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:48:40,204 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:48:40,388 MainProcess] boa: Trials so far: 29
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
20: {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
21: {'branin': -5.821328163146973, 'currin': -3.086317539215088},
22: {'branin': -8.420209884643555, 'currin': -2.5384483337402344},
25: {'branin': -0.5703239440917969, 'currin': -5.411530017852783}}
[INFO 08-09 18:48:40] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:41] Scheduler: Running trials [29]...
[INFO 08-09 18:48:42] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:44] Scheduler: Running trials [30]...
[INFO 08-09 18:48:44] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:45] Scheduler: Running trials [31]...
[INFO 08-09 18:48:45] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:45] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:48:45] Scheduler: Retrieved COMPLETED trials: 29 - 31.
[INFO 08-09 18:48:45] Scheduler: Fetching data for trials: 29 - 31.
[ERROR 2023-08-09 18:48:45,671 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:48:45,726 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:48:45,752 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:48:45,941 MainProcess] boa: Trials so far: 32
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
20: {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
21: {'branin': -5.821328163146973, 'currin': -3.086317539215088},
22: {'branin': -8.420209884643555, 'currin': -2.5384483337402344},
25: {'branin': -0.5703239440917969, 'currin': -5.411530017852783},
29: {'branin': -4.06641149520874, 'currin': -3.608851432800293},
30: {'branin': -2.8376221656799316, 'currin': -4.052033424377441},
31: {'branin': -1.0162372589111328, 'currin': -4.916433334350586}}
[INFO 08-09 18:48:45] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:47] Scheduler: Running trials [32]...
[INFO 08-09 18:48:48] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:49] Scheduler: Running trials [33]...
[INFO 08-09 18:48:50] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:51] Scheduler: Running trials [34]...
[INFO 08-09 18:48:52] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:52] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:48:52] Scheduler: Retrieved COMPLETED trials: 32 - 34.
[INFO 08-09 18:48:52] Scheduler: Fetching data for trials: 32 - 34.
[ERROR 2023-08-09 18:48:53,006 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:48:53,068 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:48:53,094 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:48:53,290 MainProcess] boa: Trials so far: 35
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
20: {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
21: {'branin': -5.821328163146973, 'currin': -3.086317539215088},
22: {'branin': -8.420209884643555, 'currin': -2.5384483337402344},
25: {'branin': -0.5703239440917969, 'currin': -5.411530017852783},
29: {'branin': -4.06641149520874, 'currin': -3.608851432800293},
30: {'branin': -2.8376221656799316, 'currin': -4.052033424377441},
31: {'branin': -1.0162372589111328, 'currin': -4.916433334350586},
32: {'branin': -14.462695121765137, 'currin': -1.580868124961853},
33: {'branin': -10.729584693908691, 'currin': -2.138476610183716},
34: {'branin': -1.8216123580932617, 'currin': -4.479681015014648}}
[INFO 08-09 18:48:53] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:54] Scheduler: Running trials [35]...
[INFO 08-09 18:48:55] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:48:57] Scheduler: Running trials [36]...
[INFO 08-09 18:48:58] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:00] Scheduler: Running trials [37]...
[INFO 08-09 18:49:01] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:01] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:49:01] Scheduler: Retrieved COMPLETED trials: 35 - 37.
[INFO 08-09 18:49:01] Scheduler: Fetching data for trials: 35 - 37.
[ERROR 2023-08-09 18:49:01,986 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:49:02,051 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:49:02,079 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:49:02,276 MainProcess] boa: Trials so far: 38
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
20: {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
21: {'branin': -5.821328163146973, 'currin': -3.086317539215088},
22: {'branin': -8.420209884643555, 'currin': -2.5384483337402344},
25: {'branin': -0.5703239440917969, 'currin': -5.411530017852783},
29: {'branin': -4.06641149520874, 'currin': -3.608851432800293},
30: {'branin': -2.8376221656799316, 'currin': -4.052033424377441},
31: {'branin': -1.0162372589111328, 'currin': -4.916433334350586},
32: {'branin': -14.462695121765137, 'currin': -1.580868124961853},
33: {'branin': -10.729584693908691, 'currin': -2.138476610183716},
34: {'branin': -1.8216123580932617, 'currin': -4.479681015014648},
35: {'branin': -12.54854965209961, 'currin': -1.8558590412139893},
36: {'branin': -5.24821662902832, 'currin': -3.2351295948028564},
37: {'branin': -9.126726150512695, 'currin': -2.4100160598754883}}
[INFO 08-09 18:49:02] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:03] Scheduler: Running trials [38]...
[INFO 08-09 18:49:04] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:06] Scheduler: Running trials [39]...
[INFO 08-09 18:49:07] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:08] Scheduler: Running trials [40]...
[INFO 08-09 18:49:09] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:09] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:49:09] Scheduler: Retrieved COMPLETED trials: 38 - 40.
[INFO 08-09 18:49:09] Scheduler: Fetching data for trials: 38 - 40.
[ERROR 2023-08-09 18:49:09,930 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:49:09,999 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:49:10,026 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:49:10,217 MainProcess] boa: Trials so far: 41
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
20: {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
21: {'branin': -5.821328163146973, 'currin': -3.086317539215088},
22: {'branin': -8.420209884643555, 'currin': -2.5384483337402344},
25: {'branin': -0.5703239440917969, 'currin': -5.411530017852783},
29: {'branin': -4.06641149520874, 'currin': -3.608851432800293},
30: {'branin': -2.8376221656799316, 'currin': -4.052033424377441},
31: {'branin': -1.0162372589111328, 'currin': -4.916433334350586},
32: {'branin': -14.462695121765137, 'currin': -1.580868124961853},
33: {'branin': -10.729584693908691, 'currin': -2.138476610183716},
34: {'branin': -1.8216123580932617, 'currin': -4.479681015014648},
35: {'branin': -12.54854965209961, 'currin': -1.8558590412139893},
36: {'branin': -5.24821662902832, 'currin': -3.2351295948028564},
37: {'branin': -9.126726150512695, 'currin': -2.4100160598754883},
38: {'branin': -0.42482948303222656, 'currin': -5.532975673675537},
39: {'branin': -3.7471671104431152, 'currin': -3.71850323677063},
40: {'branin': -7.734133720397949, 'currin': -2.6697120666503906}}
[INFO 08-09 18:49:10] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:11] Scheduler: Running trials [41]...
[INFO 08-09 18:49:12] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:14] Scheduler: Running trials [42]...
[INFO 08-09 18:49:15] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:17] Scheduler: Running trials [43]...
[INFO 08-09 18:49:18] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:18] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:49:18] Scheduler: Retrieved COMPLETED trials: 41 - 43.
[INFO 08-09 18:49:18] Scheduler: Fetching data for trials: 41 - 43.
[ERROR 2023-08-09 18:49:18,268 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:49:18,345 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:49:18,373 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:49:18,561 MainProcess] boa: Trials so far: 44
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
20: {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
21: {'branin': -5.821328163146973, 'currin': -3.086317539215088},
22: {'branin': -8.420209884643555, 'currin': -2.5384483337402344},
25: {'branin': -0.5703239440917969, 'currin': -5.411530017852783},
29: {'branin': -4.06641149520874, 'currin': -3.608851432800293},
30: {'branin': -2.8376221656799316, 'currin': -4.052033424377441},
31: {'branin': -1.0162372589111328, 'currin': -4.916433334350586},
32: {'branin': -14.462695121765137, 'currin': -1.580868124961853},
33: {'branin': -10.729584693908691, 'currin': -2.138476610183716},
34: {'branin': -1.8216123580932617, 'currin': -4.479681015014648},
35: {'branin': -12.54854965209961, 'currin': -1.8558590412139893},
36: {'branin': -5.24821662902832, 'currin': -3.2351295948028564},
37: {'branin': -9.126726150512695, 'currin': -2.4100160598754883},
38: {'branin': -0.42482948303222656, 'currin': -5.532975673675537},
39: {'branin': -3.7471671104431152, 'currin': -3.71850323677063},
40: {'branin': -7.734133720397949, 'currin': -2.6697120666503906},
41: {'branin': -6.431496620178223, 'currin': -2.9428746700286865},
42: {'branin': -4.387602806091309, 'currin': -3.500368356704712},
43: {'branin': -2.5462594032287598, 'currin': -4.166186332702637}}
[INFO 08-09 18:49:18] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:19] Scheduler: Running trials [44]...
[INFO 08-09 18:49:20] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:22] Scheduler: Running trials [45]...
[INFO 08-09 18:49:22] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:23] Scheduler: Running trials [46]...
[INFO 08-09 18:49:24] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:24] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-09 18:49:24] Scheduler: Retrieved COMPLETED trials: 44 - 46.
[INFO 08-09 18:49:24] Scheduler: Fetching data for trials: 44 - 46.
[ERROR 2023-08-09 18:49:24,762 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:49:24,841 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:49:24,869 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:49:25,084 MainProcess] boa: Trials so far: 47
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
20: {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
21: {'branin': -5.821328163146973, 'currin': -3.086317539215088},
22: {'branin': -8.420209884643555, 'currin': -2.5384483337402344},
25: {'branin': -0.5703239440917969, 'currin': -5.411530017852783},
29: {'branin': -4.06641149520874, 'currin': -3.608851432800293},
30: {'branin': -2.8376221656799316, 'currin': -4.052033424377441},
31: {'branin': -1.0162372589111328, 'currin': -4.916433334350586},
32: {'branin': -14.462695121765137, 'currin': -1.580868124961853},
33: {'branin': -10.729584693908691, 'currin': -2.138476610183716},
34: {'branin': -1.8216123580932617, 'currin': -4.479681015014648},
35: {'branin': -12.54854965209961, 'currin': -1.8558590412139893},
36: {'branin': -5.24821662902832, 'currin': -3.2351295948028564},
37: {'branin': -9.126726150512695, 'currin': -2.4100160598754883},
38: {'branin': -0.42482948303222656, 'currin': -5.532975673675537},
39: {'branin': -3.7471671104431152, 'currin': -3.71850323677063},
40: {'branin': -7.734133720397949, 'currin': -2.6697120666503906},
41: {'branin': -6.431496620178223, 'currin': -2.9428746700286865},
42: {'branin': -4.387602806091309, 'currin': -3.500368356704712},
43: {'branin': -2.5462594032287598, 'currin': -4.166186332702637},
45: {'branin': -16.473278045654297, 'currin': -1.311963438987732}}
[INFO 08-09 18:49:25] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:26] Scheduler: Running trials [47]...
[INFO 08-09 18:49:27] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:28] Scheduler: Running trials [48]...
[INFO 08-09 18:49:29] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-09 18:49:31] Scheduler: Running trials [49]...
[INFO 08-09 18:49:32] Scheduler: Retrieved COMPLETED trials: 47 - 49.
[INFO 08-09 18:49:32] Scheduler: Fetching data for trials: 47 - 49.
[ERROR 2023-08-09 18:49:32,247 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:49:32,335 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:49:32,365 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 2023-08-09 18:49:32,570 MainProcess] boa: Trials so far: 50
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
20: {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
21: {'branin': -5.821328163146973, 'currin': -3.086317539215088},
22: {'branin': -8.420209884643555, 'currin': -2.5384483337402344},
25: {'branin': -0.5703239440917969, 'currin': -5.411530017852783},
29: {'branin': -4.06641149520874, 'currin': -3.608851432800293},
30: {'branin': -2.8376221656799316, 'currin': -4.052033424377441},
31: {'branin': -1.0162372589111328, 'currin': -4.916433334350586},
32: {'branin': -14.462695121765137, 'currin': -1.580868124961853},
33: {'branin': -10.729584693908691, 'currin': -2.138476610183716},
34: {'branin': -1.8216123580932617, 'currin': -4.479681015014648},
35: {'branin': -12.54854965209961, 'currin': -1.8558590412139893},
36: {'branin': -5.24821662902832, 'currin': -3.2351295948028564},
37: {'branin': -9.126726150512695, 'currin': -2.4100160598754883},
38: {'branin': -0.42482948303222656, 'currin': -5.532975673675537},
39: {'branin': -3.7471671104431152, 'currin': -3.71850323677063},
40: {'branin': -7.734133720397949, 'currin': -2.6697120666503906},
41: {'branin': -6.431496620178223, 'currin': -2.9428746700286865},
42: {'branin': -4.387602806091309, 'currin': -3.500368356704712},
43: {'branin': -2.5462594032287598, 'currin': -4.166186332702637},
45: {'branin': -16.473278045654297, 'currin': -1.311963438987732},
47: {'branin': -3.1316747665405273, 'currin': -3.9399783611297607},
48: {'branin': -2.0487418174743652, 'currin': -4.375733852386475},
49: {'branin': -1.6042413711547852, 'currin': -4.5840253829956055}}
[ERROR 2023-08-09 18:49:32,571 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f99d7742590> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-09 18:49:32,655 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/scheduler.json`.
Boa version: 0.8.8.dev0+gd6e453f.d20230809
[INFO 2023-08-09 18:49:32,684 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743/optimization.csv`.
[INFO 08-09 18:49:32] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 2023-08-09 18:49:32,721 MainProcess] boa: Trials so far: 50
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -4.713649749755859, 'currin': -3.393146276473999},
12: {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
13: {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
14: {'branin': -2.283024787902832, 'currin': -4.283733367919922},
15: {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
16: {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
17: {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
18: {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
19: {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
20: {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
21: {'branin': -5.821328163146973, 'currin': -3.086317539215088},
22: {'branin': -8.420209884643555, 'currin': -2.5384483337402344},
25: {'branin': -0.5703239440917969, 'currin': -5.411530017852783},
29: {'branin': -4.06641149520874, 'currin': -3.608851432800293},
30: {'branin': -2.8376221656799316, 'currin': -4.052033424377441},
31: {'branin': -1.0162372589111328, 'currin': -4.916433334350586},
32: {'branin': -14.462695121765137, 'currin': -1.580868124961853},
33: {'branin': -10.729584693908691, 'currin': -2.138476610183716},
34: {'branin': -1.8216123580932617, 'currin': -4.479681015014648},
35: {'branin': -12.54854965209961, 'currin': -1.8558590412139893},
36: {'branin': -5.24821662902832, 'currin': -3.2351295948028564},
37: {'branin': -9.126726150512695, 'currin': -2.4100160598754883},
38: {'branin': -0.42482948303222656, 'currin': -5.532975673675537},
39: {'branin': -3.7471671104431152, 'currin': -3.71850323677063},
40: {'branin': -7.734133720397949, 'currin': -2.6697120666503906},
41: {'branin': -6.431496620178223, 'currin': -2.9428746700286865},
42: {'branin': -4.387602806091309, 'currin': -3.500368356704712},
43: {'branin': -2.5462594032287598, 'currin': -4.166186332702637},
45: {'branin': -16.473278045654297, 'currin': -1.311963438987732},
47: {'branin': -3.1316747665405273, 'currin': -3.9399783611297607},
48: {'branin': -2.0487418174743652, 'currin': -4.375733852386475},
49: {'branin': -1.6042413711547852, 'currin': -4.5840253829956055}}
[INFO 2023-08-09 18:49:32,755 MainProcess] boa:
##############################################
Trials Completed!
BOA Experiment Run
Output Experiment Dir: /home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.7/docs/examples/moo_run_20230809T184743
Start Time: 20230809T184743
Version: 0.8.8.dev0+gd6e453f.d20230809
End Time: 20230809T184932
Total Run Time: 109.26837038993835
trial_index arm_name trial_status generation_method branin \
0 0 0_0 COMPLETED Sobol -2.719976
1 1 1_0 COMPLETED Sobol -36.659565
2 2 2_0 COMPLETED Sobol -2.638325
3 3 3_0 COMPLETED Sobol -37.142315
4 4 4_0 COMPLETED Sobol -7.816799
5 5 5_0 COMPLETED MOO -17.508297
6 6 6_0 COMPLETED MOO -133.595383
7 7 7_0 COMPLETED MOO -26.399782
8 8 8_0 COMPLETED MOO -14.174684
9 9 9_0 COMPLETED MOO -145.872208
10 10 10_0 COMPLETED MOO -204.534088
11 11 11_0 COMPLETED MOO -4.713650
12 12 12_0 COMPLETED MOO -0.709949
13 13 13_0 COMPLETED MOO -9.850220
14 14 14_0 COMPLETED MOO -2.283025
15 15 15_0 COMPLETED MOO -13.486032
16 16 16_0 COMPLETED MOO -7.068523
17 17 17_0 COMPLETED MOO -3.432838
18 18 18_0 COMPLETED MOO -11.629309
19 19 19_0 COMPLETED MOO -15.457872
20 20 20_0 COMPLETED MOO -1.395139
21 21 21_0 COMPLETED MOO -5.821328
22 22 22_0 COMPLETED MOO -8.420210
23 23 23_0 COMPLETED MOO -308.129059
24 24 24_0 COMPLETED MOO -209.034531
25 25 25_0 COMPLETED MOO -0.570324
26 26 26_0 COMPLETED MOO -19.815632
27 27 27_0 COMPLETED MOO -46.475994
28 28 28_0 COMPLETED MOO -71.739395
29 29 29_0 COMPLETED MOO -4.066411
30 30 30_0 COMPLETED MOO -2.837622
31 31 31_0 COMPLETED MOO -1.016237
32 32 32_0 COMPLETED MOO -14.462695
33 33 33_0 COMPLETED MOO -10.729585
34 34 34_0 COMPLETED MOO -1.821612
35 35 35_0 COMPLETED MOO -12.548550
36 36 36_0 COMPLETED MOO -5.248217
37 37 37_0 COMPLETED MOO -9.126726
38 38 38_0 COMPLETED MOO -0.424829
39 39 39_0 COMPLETED MOO -3.747167
40 40 40_0 COMPLETED MOO -7.734134
41 41 41_0 COMPLETED MOO -6.431497
42 42 42_0 COMPLETED MOO -4.387603
43 43 43_0 COMPLETED MOO -2.546259
44 44 44_0 COMPLETED MOO -145.743256
45 45 45_0 COMPLETED MOO -16.473278
46 46 46_0 COMPLETED MOO -29.531307
47 47 47_0 COMPLETED MOO -3.131675
48 48 48_0 COMPLETED MOO -2.048742
49 49 49_0 COMPLETED MOO -1.604241
currin is_feasible x0 x1
0 -11.558418 False 0.520418 0.080943
1 -6.744904 False 0.320099 0.698258
2 -10.179832 False 0.917011 0.103962
3 -2.986329 False 0.028481 0.709507
4 -11.793054 False 0.488008 0.061027
5 -1.180408 True 0.000000 1.000000
6 -2.106308 False 0.000000 0.412880
7 -1.279502 False 0.000000 0.899283
8 -5.179995 True 0.149196 1.000000
9 -4.005316 False 1.000000 1.000000
10 -4.252355 False 0.680291 1.000000
11 -3.393146 True 0.058542 1.000000
12 -5.164632 True 0.106875 0.861769
13 -2.284392 True 0.027474 1.000000
14 -4.283733 True 0.081587 0.931813
15 -1.718625 True 0.013209 1.000000
16 -2.804686 True 0.041334 1.000000
17 -3.829843 True 0.070074 0.971204
18 -1.995750 True 0.020122 1.000000
19 -1.445443 True 0.006484 1.000000
20 -4.692270 True 0.094069 0.906978
21 -3.086318 True 0.049311 1.000000
22 -2.538448 True 0.034124 1.000000
23 -3.000000 False 0.000000 0.000000
24 -9.445279 False 0.069094 0.000000
25 -5.411530 True 0.118544 0.856327
26 -6.571651 False 1.000000 0.482036
27 -7.283415 False 0.775303 0.424349
28 -6.195619 False 0.781226 0.561377
29 -3.608851 True 0.064077 0.984773
30 -4.052033 True 0.075871 0.953754
31 -4.916433 True 0.100634 0.888584
32 -1.580868 True 0.009810 1.000000
33 -2.138477 True 0.023734 1.000000
34 -4.479681 True 0.087771 0.922329
35 -1.855859 True 0.016618 1.000000
36 -3.235130 True 0.053708 1.000000
37 -2.410016 True 0.030738 1.000000
38 -5.532976 True 0.119436 0.834022
39 -3.718503 True 0.067072 0.978475
40 -2.669712 True 0.037644 1.000000
41 -2.942875 True 0.045197 1.000000
42 -3.500368 True 0.061357 0.993322
43 -4.166186 True 0.079145 0.946783
44 -4.659629 False 0.481414 1.000000
45 -1.311963 True 0.003216 1.000000
46 -7.101822 False 0.521592 0.525910
47 -3.939978 True 0.073018 0.963363
48 -4.375734 True 0.084998 0.931396
49 -4.584025 True 0.090909 0.915320
##############################################
Get the Best Trial#
best_fitted_trials uses the data to do a fitting from all trials and with the noise levels you provided (or if no noise levels was provided, it assumed an unknown level of noise and inferred the noise level from the trial runs)
1trial = scheduler.best_fitted_trials()
2trial
[INFO 08-09 18:49:32] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
{11: {'params': {'x0': 0.05854202359529262, 'x1': 1.0},
'means': {'branin': -4.714441285827993, 'currin': -3.393129010472263},
'cov_matrix': {'branin': {'branin': 0.0001815645467311559, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 3.008040747021482e-06}}},
12: {'params': {'x0': 0.10687501379702964, 'x1': 0.8617687681580435},
'means': {'branin': -0.7100246390621283, 'currin': -5.164387172062842},
'cov_matrix': {'branin': {'branin': 0.000243968087764005, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 4.805432480333525e-06}}},
13: {'params': {'x0': 0.027473573209238905, 'x1': 1.0},
'means': {'branin': -9.850257699910536, 'currin': -2.2843653278512432},
'cov_matrix': {'branin': {'branin': 7.934444545040903e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.4294113827733187e-06}}},
14: {'params': {'x0': 0.08158653987033523, 'x1': 0.9318133238370674},
'means': {'branin': -2.2834906636619827, 'currin': -4.283484681882742},
'cov_matrix': {'branin': {'branin': 0.00022247455971343338, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 3.3339670960076363e-06}}},
15: {'params': {'x0': 0.0132091473010553, 'x1': 1.0},
'means': {'branin': -13.485655293382786, 'currin': -1.7186565163173797},
'cov_matrix': {'branin': {'branin': 7.881746946065075e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.5055938564600257e-06}}},
16: {'params': {'x0': 0.04133430391389316, 'x1': 1.0},
'means': {'branin': -7.068719045209803, 'currin': -2.804695554098319},
'cov_matrix': {'branin': {'branin': 8.49713875210581e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.528887371423662e-06}}},
17: {'params': {'x0': 0.07007363440350005, 'x1': 0.9712042038829277},
'means': {'branin': -3.433014869316997, 'currin': -3.82986531814635},
'cov_matrix': {'branin': {'branin': 9.825533101381602e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.4578135735833283e-06}}},
18: {'params': {'x0': 0.020121867222561696, 'x1': 1.0},
'means': {'branin': -11.628878705650916, 'currin': -1.9957049690359052},
'cov_matrix': {'branin': {'branin': 8.102021216062383e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.4434730869234927e-06}}},
19: {'params': {'x0': 0.006483643799602639, 'x1': 1.0},
'means': {'branin': -15.459745813479044, 'currin': -1.4455831644473487},
'cov_matrix': {'branin': {'branin': 9.022812023572413e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.6160153854499819e-06}}},
20: {'params': {'x0': 0.09406925989997199, 'x1': 0.9069778622356273},
'means': {'branin': -1.3955173947684862, 'currin': -4.692338714480997},
'cov_matrix': {'branin': {'branin': 0.0001421401444085797, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.055649064357802e-06}}},
21: {'params': {'x0': 0.04931123627466197, 'x1': 1.0},
'means': {'branin': -5.820921113751615, 'currin': -3.0863101412578824},
'cov_matrix': {'branin': {'branin': 0.00010111778529964224, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.7795140545054549e-06}}},
22: {'params': {'x0': 0.03412409603364241, 'x1': 1.0},
'means': {'branin': -8.420304947858806, 'currin': -2.538450398898421},
'cov_matrix': {'branin': {'branin': 7.888626083920077e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.4204940156262648e-06}}},
25: {'params': {'x0': 0.1185438614198475, 'x1': 0.8563268206150751},
'means': {'branin': -0.5696968757930421, 'currin': -5.411273800132302},
'cov_matrix': {'branin': {'branin': 0.00024872560035799925, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 5.47841151712779e-06}}},
29: {'params': {'x0': 0.0640770440523512, 'x1': 0.9847732568974031},
'means': {'branin': -4.066021334912447, 'currin': -3.6088471467227587},
'cov_matrix': {'branin': {'branin': 0.00012207176495669796, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.7277076711099565e-06}}},
30: {'params': {'x0': 0.07587056914148772, 'x1': 0.9537539383020814},
'means': {'branin': -2.8372159731873143, 'currin': -4.052034950999333},
'cov_matrix': {'branin': {'branin': 0.00010863341287844686, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.4960988163547648e-06}}},
31: {'params': {'x0': 0.10063391725982243, 'x1': 0.8885844470673756},
'means': {'branin': -1.0161302650614363, 'currin': -4.916552892323558},
'cov_matrix': {'branin': {'branin': 0.00021519911744994293, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.9938555196768072e-06}}},
32: {'params': {'x0': 0.009809598267982297, 'x1': 1.0},
'means': {'branin': -14.463298744854367, 'currin': -1.5809686485523762},
'cov_matrix': {'branin': {'branin': 8.30856659146231e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.6091794523461322e-06}}},
33: {'params': {'x0': 0.023733975932905424, 'x1': 1.0},
'means': {'branin': -10.729449601166708, 'currin': -2.1384333664214243},
'cov_matrix': {'branin': {'branin': 8.128909358509473e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.448839681718723e-06}}},
34: {'params': {'x0': 0.08777109293363446, 'x1': 0.9223287995541318},
'means': {'branin': -1.8210526736997377, 'currin': -4.479672489152282},
'cov_matrix': {'branin': {'branin': 9.608177266305504e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.473364713486257e-06}}},
35: {'params': {'x0': 0.016617974637606666, 'x1': 1.0},
'means': {'branin': -12.547911015574444, 'currin': -1.8558375059191414},
'cov_matrix': {'branin': {'branin': 7.959590208532595e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.4433480314956533e-06}}},
36: {'params': {'x0': 0.05370765070977513, 'x1': 1.0},
'means': {'branin': -5.2473686368332455, 'currin': -3.235109536815651},
'cov_matrix': {'branin': {'branin': 0.00010617061153638801, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.7122174322348685e-06}}},
37: {'params': {'x0': 0.030737693950976513, 'x1': 1.0},
'means': {'branin': -9.126800651976765, 'currin': -2.4100054601825276},
'cov_matrix': {'branin': {'branin': 7.785777226829212e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.4132799882039549e-06}}},
38: {'params': {'x0': 0.11943596821086822, 'x1': 0.8340218156747671},
'means': {'branin': -0.4254308720428739, 'currin': -5.533315686259421},
'cov_matrix': {'branin': {'branin': 0.0002490289540649597, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 5.540464721470933e-06}}},
39: {'params': {'x0': 0.06707166627773925, 'x1': 0.9784749814555573},
'means': {'branin': -3.7471331080191064, 'currin': -3.7185115990583357},
'cov_matrix': {'branin': {'branin': 9.400910091570515e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.5264940019590355e-06}}},
40: {'params': {'x0': 0.0376440470932716, 'x1': 1.0},
'means': {'branin': -7.734280164397192, 'currin': -2.6697213115303953},
'cov_matrix': {'branin': {'branin': 8.177998305423866e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.455569481426992e-06}}},
41: {'params': {'x0': 0.045197372698289474, 'x1': 1.0},
'means': {'branin': -6.431559878092923, 'currin': -2.9428789021089132},
'cov_matrix': {'branin': {'branin': 8.947337937080375e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.6619939928047842e-06}}},
42: {'params': {'x0': 0.061357334836507155, 'x1': 0.9933215627790452},
'means': {'branin': -4.387908687991345, 'currin': -3.500370000040226},
'cov_matrix': {'branin': {'branin': 0.00010425324481528872, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.600953185403348e-06}}},
43: {'params': {'x0': 0.07914480016080724, 'x1': 0.9467832018270409},
'means': {'branin': -2.5462696868638854, 'currin': -4.1662556464138145},
'cov_matrix': {'branin': {'branin': 0.00013397671899050104, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.7342953614234308e-06}}},
45: {'params': {'x0': 0.003215758667041679, 'x1': 1.0},
'means': {'branin': -16.475013417313576, 'currin': -1.3120384690826787},
'cov_matrix': {'branin': {'branin': 8.929693350568879e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.7891640075991629e-06}}},
47: {'params': {'x0': 0.07301828831608549, 'x1': 0.9633629151544364},
'means': {'branin': -3.1318999898706608, 'currin': -3.9400142010676573},
'cov_matrix': {'branin': {'branin': 0.00010259893765619666, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.4947563280760458e-06}}},
48: {'params': {'x0': 0.08499791286054587, 'x1': 0.9313955458554346},
'means': {'branin': -2.0487358003140343, 'currin': -4.375811359227041},
'cov_matrix': {'branin': {'branin': 0.0001425005341587312, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.7285418147416728e-06}}},
49: {'params': {'x0': 0.09090853925359971, 'x1': 0.9153204303258963},
'means': {'branin': -1.6043636924835862, 'currin': -4.584071116340044},
'cov_matrix': {'branin': {'branin': 0.00010279469401579716, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.6796869745255598e-06}}},
5: {'params': {'x0': 0.0, 'x1': 1.0},
'means': {'branin': -17.505493451071054, 'currin': -1.1802108255454078},
'cov_matrix': {'branin': {'branin': 0.0002037202628074062, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 4.270066048327181e-06}}}}
if you need the exact points of the best trial, maybe because you need the trial number of the best trial to plot results, or for any other reason, best_raw_trails does not do any fitting
1trial = scheduler.best_raw_trials()
2trial
[INFO 08-09 18:49:32] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
{11: {'params': {'x0': 0.05854202359529262, 'x1': 1.0},
'means': {'branin': -4.713649749755859, 'currin': -3.393146276473999},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
12: {'params': {'x0': 0.10687501379702964, 'x1': 0.8617687681580435},
'means': {'branin': -0.7099485397338867, 'currin': -5.164632320404053},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
13: {'params': {'x0': 0.027473573209238905, 'x1': 1.0},
'means': {'branin': -9.8502197265625, 'currin': -2.2843918800354004},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
14: {'params': {'x0': 0.08158653987033523, 'x1': 0.9318133238370674},
'means': {'branin': -2.283024787902832, 'currin': -4.283733367919922},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
15: {'params': {'x0': 0.0132091473010553, 'x1': 1.0},
'means': {'branin': -13.486031532287598, 'currin': -1.7186249494552612},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
16: {'params': {'x0': 0.04133430391389316, 'x1': 1.0},
'means': {'branin': -7.068523406982422, 'currin': -2.8046858310699463},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
17: {'params': {'x0': 0.07007363440350005, 'x1': 0.9712042038829277},
'means': {'branin': -3.4328384399414062, 'currin': -3.8298425674438477},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
18: {'params': {'x0': 0.020121867222561696, 'x1': 1.0},
'means': {'branin': -11.629308700561523, 'currin': -1.9957504272460938},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
19: {'params': {'x0': 0.006483643799602639, 'x1': 1.0},
'means': {'branin': -15.45787239074707, 'currin': -1.4454429149627686},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
20: {'params': {'x0': 0.09406925989997199, 'x1': 0.9069778622356273},
'means': {'branin': -1.3951387405395508, 'currin': -4.692269802093506},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
21: {'params': {'x0': 0.04931123627466197, 'x1': 1.0},
'means': {'branin': -5.821328163146973, 'currin': -3.086317539215088},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
22: {'params': {'x0': 0.03412409603364241, 'x1': 1.0},
'means': {'branin': -8.420209884643555, 'currin': -2.5384483337402344},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
25: {'params': {'x0': 0.1185438614198475, 'x1': 0.8563268206150751},
'means': {'branin': -0.5703239440917969, 'currin': -5.411530017852783},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
29: {'params': {'x0': 0.0640770440523512, 'x1': 0.9847732568974031},
'means': {'branin': -4.06641149520874, 'currin': -3.608851432800293},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
30: {'params': {'x0': 0.07587056914148772, 'x1': 0.9537539383020814},
'means': {'branin': -2.8376221656799316, 'currin': -4.052033424377441},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
31: {'params': {'x0': 0.10063391725982243, 'x1': 0.8885844470673756},
'means': {'branin': -1.0162372589111328, 'currin': -4.916433334350586},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
32: {'params': {'x0': 0.009809598267982297, 'x1': 1.0},
'means': {'branin': -14.462695121765137, 'currin': -1.580868124961853},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
33: {'params': {'x0': 0.023733975932905424, 'x1': 1.0},
'means': {'branin': -10.729584693908691, 'currin': -2.138476610183716},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
34: {'params': {'x0': 0.08777109293363446, 'x1': 0.9223287995541318},
'means': {'branin': -1.8216123580932617, 'currin': -4.479681015014648},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
35: {'params': {'x0': 0.016617974637606666, 'x1': 1.0},
'means': {'branin': -12.54854965209961, 'currin': -1.8558590412139893},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
36: {'params': {'x0': 0.05370765070977513, 'x1': 1.0},
'means': {'branin': -5.24821662902832, 'currin': -3.2351295948028564},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
37: {'params': {'x0': 0.030737693950976513, 'x1': 1.0},
'means': {'branin': -9.126726150512695, 'currin': -2.4100160598754883},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
38: {'params': {'x0': 0.11943596821086822, 'x1': 0.8340218156747671},
'means': {'branin': -0.42482948303222656, 'currin': -5.532975673675537},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
39: {'params': {'x0': 0.06707166627773925, 'x1': 0.9784749814555573},
'means': {'branin': -3.7471671104431152, 'currin': -3.71850323677063},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
40: {'params': {'x0': 0.0376440470932716, 'x1': 1.0},
'means': {'branin': -7.734133720397949, 'currin': -2.6697120666503906},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
41: {'params': {'x0': 0.045197372698289474, 'x1': 1.0},
'means': {'branin': -6.431496620178223, 'currin': -2.9428746700286865},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
42: {'params': {'x0': 0.061357334836507155, 'x1': 0.9933215627790452},
'means': {'branin': -4.387602806091309, 'currin': -3.500368356704712},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
43: {'params': {'x0': 0.07914480016080724, 'x1': 0.9467832018270409},
'means': {'branin': -2.5462594032287598, 'currin': -4.166186332702637},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
45: {'params': {'x0': 0.003215758667041679, 'x1': 1.0},
'means': {'branin': -16.473278045654297, 'currin': -1.311963438987732},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
47: {'params': {'x0': 0.07301828831608549, 'x1': 0.9633629151544364},
'means': {'branin': -3.1316747665405273, 'currin': -3.9399783611297607},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
48: {'params': {'x0': 0.08499791286054587, 'x1': 0.9313955458554346},
'means': {'branin': -2.0487418174743652, 'currin': -4.375733852386475},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
49: {'params': {'x0': 0.09090853925359971, 'x1': 0.9153204303258963},
'means': {'branin': -1.6042413711547852, 'currin': -4.5840253829956055},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
5: {'params': {'x0': 0.0, 'x1': 1.0},
'means': {'branin': -17.508296966552734, 'currin': -1.180408000946045},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}}}
Output All Trials#
1boa.scheduler_to_df(scheduler)
| trial_index | arm_name | trial_status | generation_method | branin | currin | is_feasible | x0 | x1 | |
|---|---|---|---|---|---|---|---|---|---|
| 0 | 0 | 0_0 | COMPLETED | Sobol | -2.719976 | -11.558418 | False | 0.520418 | 0.080943 |
| 1 | 1 | 1_0 | COMPLETED | Sobol | -36.659565 | -6.744904 | False | 0.320099 | 0.698258 |
| 2 | 2 | 2_0 | COMPLETED | Sobol | -2.638325 | -10.179832 | False | 0.917011 | 0.103962 |
| 3 | 3 | 3_0 | COMPLETED | Sobol | -37.142315 | -2.986329 | False | 0.028481 | 0.709507 |
| 4 | 4 | 4_0 | COMPLETED | Sobol | -7.816799 | -11.793054 | False | 0.488008 | 0.061027 |
| 5 | 5 | 5_0 | COMPLETED | MOO | -17.508297 | -1.180408 | True | 0.000000 | 1.000000 |
| 6 | 6 | 6_0 | COMPLETED | MOO | -133.595383 | -2.106308 | False | 0.000000 | 0.412880 |
| 7 | 7 | 7_0 | COMPLETED | MOO | -26.399782 | -1.279502 | False | 0.000000 | 0.899283 |
| 8 | 8 | 8_0 | COMPLETED | MOO | -14.174684 | -5.179995 | True | 0.149196 | 1.000000 |
| 9 | 9 | 9_0 | COMPLETED | MOO | -145.872208 | -4.005316 | False | 1.000000 | 1.000000 |
| 10 | 10 | 10_0 | COMPLETED | MOO | -204.534088 | -4.252355 | False | 0.680291 | 1.000000 |
| 11 | 11 | 11_0 | COMPLETED | MOO | -4.713650 | -3.393146 | True | 0.058542 | 1.000000 |
| 12 | 12 | 12_0 | COMPLETED | MOO | -0.709949 | -5.164632 | True | 0.106875 | 0.861769 |
| 13 | 13 | 13_0 | COMPLETED | MOO | -9.850220 | -2.284392 | True | 0.027474 | 1.000000 |
| 14 | 14 | 14_0 | COMPLETED | MOO | -2.283025 | -4.283733 | True | 0.081587 | 0.931813 |
| 15 | 15 | 15_0 | COMPLETED | MOO | -13.486032 | -1.718625 | True | 0.013209 | 1.000000 |
| 16 | 16 | 16_0 | COMPLETED | MOO | -7.068523 | -2.804686 | True | 0.041334 | 1.000000 |
| 17 | 17 | 17_0 | COMPLETED | MOO | -3.432838 | -3.829843 | True | 0.070074 | 0.971204 |
| 18 | 18 | 18_0 | COMPLETED | MOO | -11.629309 | -1.995750 | True | 0.020122 | 1.000000 |
| 19 | 19 | 19_0 | COMPLETED | MOO | -15.457872 | -1.445443 | True | 0.006484 | 1.000000 |
| 20 | 20 | 20_0 | COMPLETED | MOO | -1.395139 | -4.692270 | True | 0.094069 | 0.906978 |
| 21 | 21 | 21_0 | COMPLETED | MOO | -5.821328 | -3.086318 | True | 0.049311 | 1.000000 |
| 22 | 22 | 22_0 | COMPLETED | MOO | -8.420210 | -2.538448 | True | 0.034124 | 1.000000 |
| 23 | 23 | 23_0 | COMPLETED | MOO | -308.129059 | -3.000000 | False | 0.000000 | 0.000000 |
| 24 | 24 | 24_0 | COMPLETED | MOO | -209.034531 | -9.445279 | False | 0.069094 | 0.000000 |
| 25 | 25 | 25_0 | COMPLETED | MOO | -0.570324 | -5.411530 | True | 0.118544 | 0.856327 |
| 26 | 26 | 26_0 | COMPLETED | MOO | -19.815632 | -6.571651 | False | 1.000000 | 0.482036 |
| 27 | 27 | 27_0 | COMPLETED | MOO | -46.475994 | -7.283415 | False | 0.775303 | 0.424349 |
| 28 | 28 | 28_0 | COMPLETED | MOO | -71.739395 | -6.195619 | False | 0.781226 | 0.561377 |
| 29 | 29 | 29_0 | COMPLETED | MOO | -4.066411 | -3.608851 | True | 0.064077 | 0.984773 |
| 30 | 30 | 30_0 | COMPLETED | MOO | -2.837622 | -4.052033 | True | 0.075871 | 0.953754 |
| 31 | 31 | 31_0 | COMPLETED | MOO | -1.016237 | -4.916433 | True | 0.100634 | 0.888584 |
| 32 | 32 | 32_0 | COMPLETED | MOO | -14.462695 | -1.580868 | True | 0.009810 | 1.000000 |
| 33 | 33 | 33_0 | COMPLETED | MOO | -10.729585 | -2.138477 | True | 0.023734 | 1.000000 |
| 34 | 34 | 34_0 | COMPLETED | MOO | -1.821612 | -4.479681 | True | 0.087771 | 0.922329 |
| 35 | 35 | 35_0 | COMPLETED | MOO | -12.548550 | -1.855859 | True | 0.016618 | 1.000000 |
| 36 | 36 | 36_0 | COMPLETED | MOO | -5.248217 | -3.235130 | True | 0.053708 | 1.000000 |
| 37 | 37 | 37_0 | COMPLETED | MOO | -9.126726 | -2.410016 | True | 0.030738 | 1.000000 |
| 38 | 38 | 38_0 | COMPLETED | MOO | -0.424829 | -5.532976 | True | 0.119436 | 0.834022 |
| 39 | 39 | 39_0 | COMPLETED | MOO | -3.747167 | -3.718503 | True | 0.067072 | 0.978475 |
| 40 | 40 | 40_0 | COMPLETED | MOO | -7.734134 | -2.669712 | True | 0.037644 | 1.000000 |
| 41 | 41 | 41_0 | COMPLETED | MOO | -6.431497 | -2.942875 | True | 0.045197 | 1.000000 |
| 42 | 42 | 42_0 | COMPLETED | MOO | -4.387603 | -3.500368 | True | 0.061357 | 0.993322 |
| 43 | 43 | 43_0 | COMPLETED | MOO | -2.546259 | -4.166186 | True | 0.079145 | 0.946783 |
| 44 | 44 | 44_0 | COMPLETED | MOO | -145.743256 | -4.659629 | False | 0.481414 | 1.000000 |
| 45 | 45 | 45_0 | COMPLETED | MOO | -16.473278 | -1.311963 | True | 0.003216 | 1.000000 |
| 46 | 46 | 46_0 | COMPLETED | MOO | -29.531307 | -7.101822 | False | 0.521592 | 0.525910 |
| 47 | 47 | 47_0 | COMPLETED | MOO | -3.131675 | -3.939978 | True | 0.073018 | 0.963363 |
| 48 | 48 | 48_0 | COMPLETED | MOO | -2.048742 | -4.375734 | True | 0.084998 | 0.931396 |
| 49 | 49 | 49_0 | COMPLETED | MOO | -1.604241 | -4.584025 | True | 0.090909 | 0.915320 |