Running a Multi Objective Optimization Directly in Python#
This notebook demonstrates how to:
Write a basic Wrapper in Python and launch a multi objective optimization from Python. If you wanted to launch it from command line, you would do a similar thing of defining the Wrapper, and then put in your configuration file the information about where the wrapper is, and use BOA’s CLI tools. See Running an Experiment from Command Line (Python Wrapper) for more information.
1import pathlib
2import shutil
3
4from IPython.display import Code
5
6import boa
7from boa.scripts.moo import Wrapper
[WARNING 08-11 16:13:48] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Show code cell content
1# Remove old runs to have a clean slate for this example
2old_runs = pathlib.Path().resolve().glob("moo_run*")
3for path in old_runs:
4 shutil.rmtree(path, ignore_errors=True)
Loading the MOO Config File#
1config_path = pathlib.Path().resolve().parent.parent / "boa/scripts/moo.yaml"
Here we can see what the configuration file looks like
1Code(config_path)
# MultiObjective Optimization config
optimization_options:
objective_options:
objective_thresholds:
- branin >= -18.0
- currin >= -6.0
objectives:
- name: branin
lower_is_better: False
noise_sd: 0
- name: currin
lower_is_better: False
noise_sd: 0
experiment:
name: "moo_run"
trials: 50
parameters:
x0:
type: range
bounds: [0, 1]
value_type: float
x1:
type: range
bounds: [0, 1]
value_type: float
1config = boa.load_jsonlike(config_path)
The Wrapper#
We define our wrapper in wrapper.py and use a synthetic function that stands in for any black box model call
1Code(Wrapper.path())
from pathlib import Path
import torch
from boa.controller import Controller
from boa.metrics.synthetic_funcs import get_synth_func
from boa.utils import torch_device
from boa.wrappers.base_wrapper import BaseWrapper
tkwargs = {
"device": torch_device(),
}
Problem = get_synth_func("BraninCurrin")
problem = Problem(negate=True).to(**tkwargs)
class Wrapper(BaseWrapper):
def run_model(self, trial) -> None:
pass
def set_trial_status(self, trial) -> None:
trial.mark_completed()
def fetch_trial_data(self, trial, metric_properties, metric_name, *args, **kwargs):
evaluation = problem(torch.tensor([trial.arm.parameters["x0"], trial.arm.parameters["x1"]]))
a = float(evaluation[0])
b = float(evaluation[1])
return {"branin": a, "currin": b}
def main():
config_path = Path(__file__).resolve().parent / "moo.yaml"
wrapper = Wrapper(config_path=config_path)
controller = Controller(wrapper=wrapper)
controller.initialize_scheduler()
return controller.run()
if __name__ == "__main__":
main()
The Setup#
1controller = boa.Controller(config_path=config_path, wrapper=Wrapper)
2
3controller.initialize_scheduler()
[INFO 08-11 16:13:50] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x0', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[]).
[INFO 08-11 16:13:50] ax.modelbridge.dispatch_utils: Using Models.MOO since there are more ordered parameters than there are categories for the unordered categorical parameters.
[INFO 08-11 16:13:50] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=2 num_trials=None use_batch_trials=False
[INFO 08-11 16:13:50] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=5
[INFO 08-11 16:13:50] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=5
[INFO 08-11 16:13:50] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+MOO', steps=[Sobol for 5 trials, MOO for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.
[INFO 08-11 16:13:50] Scheduler: `Scheduler` requires experiment to have immutable search space and optimization config. Setting property immutable_search_space_and_opt_config to `True` on experiment.
(Scheduler(experiment=Experiment(moo_run), generation_strategy=GenerationStrategy(name='Sobol+MOO', steps=[Sobol for 5 trials, MOO for subsequent trials]), options=SchedulerOptions(max_pending_trials=10, trial_type=<TrialType.TRIAL: 0>, batch_size=None, total_trials=None, tolerated_trial_failure_rate=0.5, min_failed_trials_for_failure_rate_check=5, log_filepath=None, logging_level=20, ttl_seconds_for_trials=None, init_seconds_between_polls=1, min_seconds_before_poll=1.0, seconds_between_polls_backoff_factor=1.5, timeout_hours=None, run_trials_in_batches=False, debug_log_run_metadata=False, early_stopping_strategy=None, global_stopping_strategy=None, suppress_storage_errors_after_retries=False)),
<boa.scripts.moo.Wrapper at 0x7f1aea404100>)
Start our Experiment#
The Controller will save our scheduler to JSON after it completes the run so we can reload it at a later time for analysis or to resume our experiment
1scheduler = controller.run()
[INFO 2023-08-11 16:13:50,358 MainProcess] boa:
##############################################
BOA Experiment Run
Output Experiment Dir: /home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350
Start Time: 20230811T161350
Version: 0.8.9.dev0+gad156f0.d20230811
##############################################
[INFO 08-11 16:13:50] Scheduler: Running trials [0]...
[INFO 08-11 16:13:51] Scheduler: Running trials [1]...
[INFO 08-11 16:13:52] Scheduler: Running trials [2]...
[INFO 08-11 16:13:53] Scheduler: Running trials [3]...
[INFO 08-11 16:13:54] Scheduler: Running trials [4]...
[INFO 08-11 16:13:55] Scheduler: Generated all trials that can be generated currently. Model requires more data to generate more trials.
[INFO 08-11 16:13:55] Scheduler: Retrieved COMPLETED trials: 0 - 4.
[INFO 08-11 16:13:55] Scheduler: Fetching data for trials: 0 - 4.
[ERROR 2023-08-11 16:13:55,484 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:13:55,496 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:13:55,519 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:13:55,609 MainProcess] boa: Trials so far: 5
Running trials:
Will Produce next trials from generation step: Sobol
Best trial so far: {}
[INFO 08-11 16:13:56] Scheduler: Running trials [5]...
[INFO 08-11 16:13:57] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:13:58] Scheduler: Running trials [6]...
[INFO 08-11 16:13:59] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:13:59] Scheduler: Running trials [7]...
[INFO 08-11 16:14:00] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:00] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:14:00] Scheduler: Retrieved COMPLETED trials: 5 - 7.
[INFO 08-11 16:14:00] Scheduler: Fetching data for trials: 5 - 7.
[ERROR 2023-08-11 16:14:00,812 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:14:00,828 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:14:00,850 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:14:00,928 MainProcess] boa: Trials so far: 8
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {}
[INFO 08-11 16:14:00] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:01] Scheduler: Running trials [8]...
[INFO 08-11 16:14:02] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:03] Scheduler: Running trials [9]...
[INFO 08-11 16:14:04] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:05] Scheduler: Running trials [10]...
[INFO 08-11 16:14:06] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:06] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:14:06] Scheduler: Retrieved COMPLETED trials: 8 - 10.
[INFO 08-11 16:14:06] Scheduler: Fetching data for trials: 8 - 10.
[ERROR 2023-08-11 16:14:06,264 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:14:06,285 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:14:06,306 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:14:06,392 MainProcess] boa: Trials so far: 11
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045}}
[INFO 08-11 16:14:06] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:07] Scheduler: Running trials [11]...
[INFO 08-11 16:14:08] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:09] Scheduler: Running trials [12]...
[INFO 08-11 16:14:10] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:11] Scheduler: Running trials [13]...
[INFO 08-11 16:14:12] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:12] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:14:12] Scheduler: Retrieved COMPLETED trials: 11 - 13.
[INFO 08-11 16:14:12] Scheduler: Fetching data for trials: 11 - 13.
[ERROR 2023-08-11 16:14:12,973 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:14:12,998 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:14:13,022 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:14:13,130 MainProcess] boa: Trials so far: 14
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713}}
[INFO 08-11 16:14:13] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:13] Scheduler: Running trials [14]...
[INFO 08-11 16:14:14] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:15] Scheduler: Running trials [15]...
[INFO 08-11 16:14:16] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:18] Scheduler: Running trials [16]...
[INFO 08-11 16:14:19] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:19] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:14:19] Scheduler: Retrieved COMPLETED trials: 14 - 16.
[INFO 08-11 16:14:19] Scheduler: Fetching data for trials: 14 - 16.
[ERROR 2023-08-11 16:14:19,267 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:14:19,298 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:14:19,320 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:14:19,449 MainProcess] boa: Trials so far: 17
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037}}
[INFO 08-11 16:14:19] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:20] Scheduler: Running trials [17]...
[INFO 08-11 16:14:21] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:22] Scheduler: Running trials [18]...
[INFO 08-11 16:14:23] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:25] Scheduler: Running trials [19]...
[INFO 08-11 16:14:26] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:26] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:14:26] Scheduler: Retrieved COMPLETED trials: 17 - 19.
[INFO 08-11 16:14:26] Scheduler: Fetching data for trials: 17 - 19.
[ERROR 2023-08-11 16:14:26,119 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:14:26,155 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:14:26,178 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:14:26,323 MainProcess] boa: Trials so far: 20
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
19: {'branin': -3.5906949043273926, 'currin': -3.9972281455993652}}
[INFO 08-11 16:14:26] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:27] Scheduler: Running trials [20]...
[INFO 08-11 16:14:28] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:30] Scheduler: Running trials [21]...
[INFO 08-11 16:14:31] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:32] Scheduler: Running trials [22]...
[INFO 08-11 16:14:33] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:33] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:14:33] Scheduler: Retrieved COMPLETED trials: 20 - 22.
[INFO 08-11 16:14:33] Scheduler: Fetching data for trials: 20 - 22.
[ERROR 2023-08-11 16:14:33,961 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:14:34,001 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:14:34,024 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:14:34,174 MainProcess] boa: Trials so far: 23
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
19: {'branin': -3.5906949043273926, 'currin': -3.9972281455993652},
20: {'branin': -4.771063327789307, 'currin': -3.374941349029541},
21: {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
22: {'branin': -7.084921836853027, 'currin': -2.8012547492980957}}
[INFO 08-11 16:14:34] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:35] Scheduler: Running trials [23]...
[INFO 08-11 16:14:36] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:37] Scheduler: Running trials [24]...
[INFO 08-11 16:14:38] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:39] Scheduler: Running trials [25]...
[INFO 08-11 16:14:40] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:40] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:14:40] Scheduler: Retrieved COMPLETED trials: 23 - 25.
[INFO 08-11 16:14:40] Scheduler: Fetching data for trials: 23 - 25.
[ERROR 2023-08-11 16:14:41,022 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:14:41,067 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:14:41,090 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:14:41,238 MainProcess] boa: Trials so far: 26
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
19: {'branin': -3.5906949043273926, 'currin': -3.9972281455993652},
20: {'branin': -4.771063327789307, 'currin': -3.374941349029541},
21: {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
22: {'branin': -7.084921836853027, 'currin': -2.8012547492980957},
23: {'branin': -11.542601585388184, 'currin': -2.009241819381714},
24: {'branin': -2.4932241439819336, 'currin': -4.248926162719727},
25: {'branin': -9.41968059539795, 'currin': -2.3584847450256348}}
[INFO 08-11 16:14:41] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:42] Scheduler: Running trials [26]...
[INFO 08-11 16:14:43] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:45] Scheduler: Running trials [27]...
[INFO 08-11 16:14:45] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:47] Scheduler: Running trials [28]...
[INFO 08-11 16:14:47] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:47] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:14:47] Scheduler: Retrieved COMPLETED trials: 26 - 28.
[INFO 08-11 16:14:47] Scheduler: Fetching data for trials: 26 - 28.
[ERROR 2023-08-11 16:14:47,645 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:14:47,694 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:14:47,867 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:14:48,022 MainProcess] boa: Trials so far: 29
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
20: {'branin': -4.771063327789307, 'currin': -3.374941349029541},
21: {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
22: {'branin': -7.084921836853027, 'currin': -2.8012547492980957},
23: {'branin': -11.542601585388184, 'currin': -2.009241819381714},
24: {'branin': -2.4932241439819336, 'currin': -4.248926162719727},
25: {'branin': -9.41968059539795, 'currin': -2.3584847450256348},
26: {'branin': -3.381143569946289, 'currin': -3.8485584259033203},
27: {'branin': -13.81873607635498, 'currin': -1.6711283922195435},
28: {'branin': -4.460362911224365, 'currin': -3.510225772857666}}
[INFO 08-11 16:14:48] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:49] Scheduler: Running trials [29]...
[INFO 08-11 16:14:50] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:51] Scheduler: Running trials [30]...
[INFO 08-11 16:14:52] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:54] Scheduler: Running trials [31]...
[INFO 08-11 16:14:55] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:55] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:14:55] Scheduler: Retrieved COMPLETED trials: 29 - 31.
[INFO 08-11 16:14:55] Scheduler: Fetching data for trials: 29 - 31.
[ERROR 2023-08-11 16:14:55,824 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:14:55,879 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:14:55,904 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:14:56,097 MainProcess] boa: Trials so far: 32
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
20: {'branin': -4.771063327789307, 'currin': -3.374941349029541},
21: {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
22: {'branin': -7.084921836853027, 'currin': -2.8012547492980957},
23: {'branin': -11.542601585388184, 'currin': -2.009241819381714},
24: {'branin': -2.4932241439819336, 'currin': -4.248926162719727},
25: {'branin': -9.41968059539795, 'currin': -2.3584847450256348},
26: {'branin': -3.381143569946289, 'currin': -3.8485584259033203},
27: {'branin': -13.81873607635498, 'currin': -1.6711283922195435},
28: {'branin': -4.460362911224365, 'currin': -3.510225772857666},
29: {'branin': -1.7303581237792969, 'currin': -4.616929531097412},
30: {'branin': -0.6959819793701172, 'currin': -5.161031246185303},
31: {'branin': -2.1924800872802734, 'currin': -4.450382232666016}}
[INFO 08-11 16:14:56] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:57] Scheduler: Running trials [32]...
[INFO 08-11 16:14:58] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:14:59] Scheduler: Running trials [33]...
[INFO 08-11 16:15:00] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:01] Scheduler: Running trials [34]...
[INFO 08-11 16:15:02] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:02] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:15:02] Scheduler: Retrieved COMPLETED trials: 32 - 34.
[INFO 08-11 16:15:02] Scheduler: Fetching data for trials: 32 - 34.
[ERROR 2023-08-11 16:15:02,799 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:15:02,859 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:15:02,885 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:15:03,101 MainProcess] boa: Trials so far: 35
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
20: {'branin': -4.771063327789307, 'currin': -3.374941349029541},
21: {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
22: {'branin': -7.084921836853027, 'currin': -2.8012547492980957},
23: {'branin': -11.542601585388184, 'currin': -2.009241819381714},
24: {'branin': -2.4932241439819336, 'currin': -4.248926162719727},
25: {'branin': -9.41968059539795, 'currin': -2.3584847450256348},
26: {'branin': -3.381143569946289, 'currin': -3.8485584259033203},
27: {'branin': -13.81873607635498, 'currin': -1.6711283922195435},
28: {'branin': -4.460362911224365, 'currin': -3.510225772857666},
29: {'branin': -1.7303581237792969, 'currin': -4.616929531097412},
30: {'branin': -0.6959819793701172, 'currin': -5.161031246185303},
31: {'branin': -2.1924800872802734, 'currin': -4.450382232666016},
32: {'branin': -1.1540794372558594, 'currin': -4.829535007476807},
34: {'branin': -0.4448356628417969, 'currin': -5.484630584716797}}
[INFO 08-11 16:15:03] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:05] Scheduler: Running trials [35]...
[INFO 08-11 16:15:06] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:08] Scheduler: Running trials [36]...
[INFO 08-11 16:15:09] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:11] Scheduler: Running trials [37]...
[INFO 08-11 16:15:13] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:13] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:15:13] Scheduler: Retrieved COMPLETED trials: 35 - 37.
[INFO 08-11 16:15:13] Scheduler: Fetching data for trials: 35 - 37.
[ERROR 2023-08-11 16:15:13,043 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:15:13,109 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:15:13,135 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:15:13,325 MainProcess] boa: Trials so far: 38
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
20: {'branin': -4.771063327789307, 'currin': -3.374941349029541},
21: {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
22: {'branin': -7.084921836853027, 'currin': -2.8012547492980957},
23: {'branin': -11.542601585388184, 'currin': -2.009241819381714},
24: {'branin': -2.4932241439819336, 'currin': -4.248926162719727},
25: {'branin': -9.41968059539795, 'currin': -2.3584847450256348},
26: {'branin': -3.381143569946289, 'currin': -3.8485584259033203},
27: {'branin': -13.81873607635498, 'currin': -1.6711283922195435},
28: {'branin': -4.460362911224365, 'currin': -3.510225772857666},
29: {'branin': -1.7303581237792969, 'currin': -4.616929531097412},
30: {'branin': -0.6959819793701172, 'currin': -5.161031246185303},
31: {'branin': -2.1924800872802734, 'currin': -4.450382232666016},
32: {'branin': -1.1540794372558594, 'currin': -4.829535007476807},
34: {'branin': -0.4448356628417969, 'currin': -5.484630584716797},
35: {'branin': -6.457882404327393, 'currin': -2.936941623687744},
36: {'branin': -2.850466251373291, 'currin': -4.04643440246582},
37: {'branin': -5.295164108276367, 'currin': -3.222275495529175}}
[INFO 08-11 16:15:13] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:16] Scheduler: Running trials [38]...
[INFO 08-11 16:15:17] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:19] Scheduler: Running trials [39]...
[INFO 08-11 16:15:20] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:22] Scheduler: Running trials [40]...
[INFO 08-11 16:15:23] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:23] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:15:23] Scheduler: Retrieved COMPLETED trials: 38 - 40.
[INFO 08-11 16:15:23] Scheduler: Fetching data for trials: 38 - 40.
[ERROR 2023-08-11 16:15:23,724 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:15:23,794 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:15:23,821 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:15:24,017 MainProcess] boa: Trials so far: 41
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
20: {'branin': -4.771063327789307, 'currin': -3.374941349029541},
21: {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
22: {'branin': -7.084921836853027, 'currin': -2.8012547492980957},
23: {'branin': -11.542601585388184, 'currin': -2.009241819381714},
24: {'branin': -2.4932241439819336, 'currin': -4.248926162719727},
25: {'branin': -9.41968059539795, 'currin': -2.3584847450256348},
26: {'branin': -3.381143569946289, 'currin': -3.8485584259033203},
27: {'branin': -13.81873607635498, 'currin': -1.6711283922195435},
28: {'branin': -4.460362911224365, 'currin': -3.510225772857666},
29: {'branin': -1.7303581237792969, 'currin': -4.616929531097412},
30: {'branin': -0.6959819793701172, 'currin': -5.161031246185303},
32: {'branin': -1.1540794372558594, 'currin': -4.829535007476807},
34: {'branin': -0.4448356628417969, 'currin': -5.484630584716797},
35: {'branin': -6.457882404327393, 'currin': -2.936941623687744},
36: {'branin': -2.850466251373291, 'currin': -4.04643440246582},
37: {'branin': -5.295164108276367, 'currin': -3.222275495529175},
38: {'branin': -7.736581802368164, 'currin': -2.6692306995391846},
40: {'branin': -1.9985685348510742, 'currin': -4.398080348968506}}
[INFO 08-11 16:15:24] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:25] Scheduler: Running trials [41]...
[INFO 08-11 16:15:26] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:27] Scheduler: Running trials [42]...
[INFO 08-11 16:15:28] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:29] Scheduler: Running trials [43]...
[INFO 08-11 16:15:29] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:29] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:15:29] Scheduler: Retrieved COMPLETED trials: 41 - 43.
[INFO 08-11 16:15:29] Scheduler: Fetching data for trials: 41 - 43.
[ERROR 2023-08-11 16:15:29,900 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:15:29,977 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:15:30,005 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:15:30,212 MainProcess] boa: Trials so far: 44
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
20: {'branin': -4.771063327789307, 'currin': -3.374941349029541},
21: {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
22: {'branin': -7.084921836853027, 'currin': -2.8012547492980957},
23: {'branin': -11.542601585388184, 'currin': -2.009241819381714},
24: {'branin': -2.4932241439819336, 'currin': -4.248926162719727},
25: {'branin': -9.41968059539795, 'currin': -2.3584847450256348},
26: {'branin': -3.381143569946289, 'currin': -3.8485584259033203},
27: {'branin': -13.81873607635498, 'currin': -1.6711283922195435},
28: {'branin': -4.460362911224365, 'currin': -3.510225772857666},
29: {'branin': -1.7303581237792969, 'currin': -4.616929531097412},
30: {'branin': -0.6959819793701172, 'currin': -5.161031246185303},
32: {'branin': -1.1540794372558594, 'currin': -4.829535007476807},
34: {'branin': -0.4448356628417969, 'currin': -5.484630584716797},
35: {'branin': -6.457882404327393, 'currin': -2.936941623687744},
36: {'branin': -2.850466251373291, 'currin': -4.04643440246582},
37: {'branin': -5.295164108276367, 'currin': -3.222275495529175},
38: {'branin': -7.736581802368164, 'currin': -2.6692306995391846},
40: {'branin': -1.9985685348510742, 'currin': -4.398080348968506},
41: {'branin': -0.9116716384887695, 'currin': -4.9881272315979}}
[INFO 08-11 16:15:30] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:31] Scheduler: Running trials [44]...
[INFO 08-11 16:15:32] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:33] Scheduler: Running trials [45]...
[INFO 08-11 16:15:34] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:35] Scheduler: Running trials [46]...
[INFO 08-11 16:15:36] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:36] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 08-11 16:15:36] Scheduler: Retrieved COMPLETED trials: 44 - 46.
[INFO 08-11 16:15:36] Scheduler: Fetching data for trials: 44 - 46.
[ERROR 2023-08-11 16:15:36,695 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:15:36,776 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:15:36,805 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:15:37,015 MainProcess] boa: Trials so far: 47
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
20: {'branin': -4.771063327789307, 'currin': -3.374941349029541},
21: {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
22: {'branin': -7.084921836853027, 'currin': -2.8012547492980957},
23: {'branin': -11.542601585388184, 'currin': -2.009241819381714},
24: {'branin': -2.4932241439819336, 'currin': -4.248926162719727},
25: {'branin': -9.41968059539795, 'currin': -2.3584847450256348},
26: {'branin': -3.381143569946289, 'currin': -3.8485584259033203},
27: {'branin': -13.81873607635498, 'currin': -1.6711283922195435},
28: {'branin': -4.460362911224365, 'currin': -3.510225772857666},
30: {'branin': -0.6959819793701172, 'currin': -5.161031246185303},
32: {'branin': -1.1540794372558594, 'currin': -4.829535007476807},
34: {'branin': -0.4448356628417969, 'currin': -5.484630584716797},
35: {'branin': -6.457882404327393, 'currin': -2.936941623687744},
36: {'branin': -2.850466251373291, 'currin': -4.04643440246582},
37: {'branin': -5.295164108276367, 'currin': -3.222275495529175},
38: {'branin': -7.736581802368164, 'currin': -2.6692306995391846},
40: {'branin': -1.9985685348510742, 'currin': -4.398080348968506},
41: {'branin': -0.9116716384887695, 'currin': -4.9881272315979},
44: {'branin': -1.5595521926879883, 'currin': -4.606469631195068},
45: {'branin': -15.629409790039062, 'currin': -1.422571063041687},
46: {'branin': -13.229970932006836, 'currin': -1.7555996179580688}}
[INFO 08-11 16:15:37] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:38] Scheduler: Running trials [47]...
[INFO 08-11 16:15:39] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:40] Scheduler: Running trials [48]...
[INFO 08-11 16:15:41] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 08-11 16:15:43] Scheduler: Running trials [49]...
[INFO 08-11 16:15:43] Scheduler: Retrieved COMPLETED trials: 47 - 49.
[INFO 08-11 16:15:43] Scheduler: Fetching data for trials: 47 - 49.
[ERROR 2023-08-11 16:15:43,287 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:15:43,371 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:15:43,401 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 2023-08-11 16:15:43,616 MainProcess] boa: Trials so far: 50
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
20: {'branin': -4.771063327789307, 'currin': -3.374941349029541},
21: {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
22: {'branin': -7.084921836853027, 'currin': -2.8012547492980957},
23: {'branin': -11.542601585388184, 'currin': -2.009241819381714},
24: {'branin': -2.4932241439819336, 'currin': -4.248926162719727},
25: {'branin': -9.41968059539795, 'currin': -2.3584847450256348},
26: {'branin': -3.381143569946289, 'currin': -3.8485584259033203},
27: {'branin': -13.81873607635498, 'currin': -1.6711283922195435},
28: {'branin': -4.460362911224365, 'currin': -3.510225772857666},
30: {'branin': -0.6959819793701172, 'currin': -5.161031246185303},
32: {'branin': -1.1540794372558594, 'currin': -4.829535007476807},
34: {'branin': -0.4448356628417969, 'currin': -5.484630584716797},
35: {'branin': -6.457882404327393, 'currin': -2.936941623687744},
36: {'branin': -2.850466251373291, 'currin': -4.04643440246582},
37: {'branin': -5.295164108276367, 'currin': -3.222275495529175},
38: {'branin': -7.736581802368164, 'currin': -2.6692306995391846},
40: {'branin': -1.9985685348510742, 'currin': -4.398080348968506},
41: {'branin': -0.9116716384887695, 'currin': -4.9881272315979},
44: {'branin': -1.5595521926879883, 'currin': -4.606469631195068},
45: {'branin': -15.629409790039062, 'currin': -1.422571063041687},
46: {'branin': -13.229970932006836, 'currin': -1.7555996179580688},
47: {'branin': -12.091843605041504, 'currin': -1.9246606826782227},
48: {'branin': -4.109103679656982, 'currin': -3.5938334465026855},
49: {'branin': -16.874921798706055, 'currin': -1.260392189025879}}
[ERROR 2023-08-11 16:15:43,618 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x7f1aea404100> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-08-11 16:15:43,704 MainProcess] boa: Saved JSON-serialized state of optimization to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/scheduler.json`.
Boa version: 0.8.9.dev0+gad156f0.d20230811
[INFO 2023-08-11 16:15:43,733 MainProcess] boa: Saved optimization parametrization and objective to `/home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350/optimization.csv`.
[INFO 08-11 16:15:43] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 2023-08-11 16:15:43,768 MainProcess] boa: Trials so far: 50
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
13: {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
14: {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
16: {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
17: {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
18: {'branin': -15.01707935333252, 'currin': -1.504840612411499},
20: {'branin': -4.771063327789307, 'currin': -3.374941349029541},
21: {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
22: {'branin': -7.084921836853027, 'currin': -2.8012547492980957},
23: {'branin': -11.542601585388184, 'currin': -2.009241819381714},
24: {'branin': -2.4932241439819336, 'currin': -4.248926162719727},
25: {'branin': -9.41968059539795, 'currin': -2.3584847450256348},
26: {'branin': -3.381143569946289, 'currin': -3.8485584259033203},
27: {'branin': -13.81873607635498, 'currin': -1.6711283922195435},
28: {'branin': -4.460362911224365, 'currin': -3.510225772857666},
30: {'branin': -0.6959819793701172, 'currin': -5.161031246185303},
32: {'branin': -1.1540794372558594, 'currin': -4.829535007476807},
34: {'branin': -0.4448356628417969, 'currin': -5.484630584716797},
35: {'branin': -6.457882404327393, 'currin': -2.936941623687744},
36: {'branin': -2.850466251373291, 'currin': -4.04643440246582},
37: {'branin': -5.295164108276367, 'currin': -3.222275495529175},
38: {'branin': -7.736581802368164, 'currin': -2.6692306995391846},
40: {'branin': -1.9985685348510742, 'currin': -4.398080348968506},
41: {'branin': -0.9116716384887695, 'currin': -4.9881272315979},
44: {'branin': -1.5595521926879883, 'currin': -4.606469631195068},
45: {'branin': -15.629409790039062, 'currin': -1.422571063041687},
46: {'branin': -13.229970932006836, 'currin': -1.7555996179580688},
47: {'branin': -12.091843605041504, 'currin': -1.9246606826782227},
48: {'branin': -4.109103679656982, 'currin': -3.5938334465026855},
49: {'branin': -16.874921798706055, 'currin': -1.260392189025879}}
[INFO 2023-08-11 16:15:43,801 MainProcess] boa:
##############################################
Trials Completed!
BOA Experiment Run
Output Experiment Dir: /home/docs/checkouts/readthedocs.org/user_builds/boa-framework/checkouts/0.8.8/docs/examples/moo_run_20230811T161350
Start Time: 20230811T161350
Version: 0.8.9.dev0+gad156f0.d20230811
End Time: 20230811T161543
Total Run Time: 113.41066527366638
trial_index arm_name trial_status generation_method branin \
0 0 0_0 COMPLETED Sobol -47.393387
1 1 1_0 COMPLETED Sobol -60.196510
2 2 2_0 COMPLETED Sobol -17.071615
3 3 3_0 COMPLETED Sobol -22.292170
4 4 4_0 COMPLETED Sobol -90.586082
5 5 5_0 COMPLETED MOO -78.735092
6 6 6_0 COMPLETED MOO -50.011749
7 7 7_0 COMPLETED MOO -9.294098
8 8 8_0 COMPLETED MOO -17.508297
9 9 9_0 COMPLETED MOO -31.137854
10 10 10_0 COMPLETED MOO -72.980576
11 11 11_0 COMPLETED MOO -3.903470
12 12 12_0 COMPLETED MOO -6.587681
13 13 13_0 COMPLETED MOO -8.407589
14 14 14_0 COMPLETED MOO -12.647774
15 15 15_0 COMPLETED MOO -11.842781
16 16 16_0 COMPLETED MOO -5.856437
17 17 17_0 COMPLETED MOO -10.465503
18 18 18_0 COMPLETED MOO -15.017079
19 19 19_0 COMPLETED MOO -3.590695
20 20 20_0 COMPLETED MOO -4.771063
21 21 21_0 COMPLETED MOO -16.248423
22 22 22_0 COMPLETED MOO -7.084922
23 23 23_0 COMPLETED MOO -11.542602
24 24 24_0 COMPLETED MOO -2.493224
25 25 25_0 COMPLETED MOO -9.419681
26 26 26_0 COMPLETED MOO -3.381144
27 27 27_0 COMPLETED MOO -13.818736
28 28 28_0 COMPLETED MOO -4.460363
29 29 29_0 COMPLETED MOO -1.730358
30 30 30_0 COMPLETED MOO -0.695982
31 31 31_0 COMPLETED MOO -2.192480
32 32 32_0 COMPLETED MOO -1.154079
33 33 33_0 COMPLETED MOO -211.882339
34 34 34_0 COMPLETED MOO -0.444836
35 35 35_0 COMPLETED MOO -6.457882
36 36 36_0 COMPLETED MOO -2.850466
37 37 37_0 COMPLETED MOO -5.295164
38 38 38_0 COMPLETED MOO -7.736582
39 39 39_0 COMPLETED MOO -0.719290
40 40 40_0 COMPLETED MOO -1.998569
41 41 41_0 COMPLETED MOO -0.911672
42 42 42_0 COMPLETED MOO -78.785782
43 43 43_0 COMPLETED MOO -64.345276
44 44 44_0 COMPLETED MOO -1.559552
45 45 45_0 COMPLETED MOO -15.629410
46 46 46_0 COMPLETED MOO -13.229971
47 47 47_0 COMPLETED MOO -12.091844
48 48 48_0 COMPLETED MOO -4.109104
49 49 49_0 COMPLETED MOO -16.874922
currin is_feasible x0 x1
0 -12.803135 False 0.220653 0.190085
1 -6.039466 False 0.544447 0.665884
2 -7.848244 False 0.893388 0.348009
3 -8.111297 False 0.394978 0.479361
4 -10.508014 False 0.107982 0.224903
5 -4.911559 False 0.969763 0.761758
6 -5.978871 False 0.291261 0.849037
7 -10.188202 False 0.989131 0.000000
8 -1.180408 True 0.000000 1.000000
9 -1.322935 False 0.000000 0.859746
10 -1.646299 False 0.000000 0.628322
11 -3.715556 True 0.069064 1.000000
12 -4.791344 True 0.117075 1.000000
13 -2.540800 True 0.034187 1.000000
14 -1.841085 True 0.016250 1.000000
15 -10.933602 False 0.647254 0.000000
16 -3.077699 True 0.049061 1.000000
17 -2.181583 True 0.024833 1.000000
18 -1.504841 True 0.007941 1.000000
19 -3.997228 True 0.079210 1.000000
20 -3.374941 True 0.057975 1.000000
21 -1.341133 True 0.003929 1.000000
22 -2.801255 True 0.041240 1.000000
23 -2.009242 True 0.020462 1.000000
24 -4.248926 True 0.084043 0.960913
25 -2.358485 True 0.029393 1.000000
26 -3.848558 True 0.070724 0.971350
27 -1.671128 True 0.012035 1.000000
28 -3.510226 True 0.060190 0.976111
29 -4.616930 True 0.095243 0.933960
30 -5.161031 True 0.108139 0.868453
31 -4.450382 True 0.091114 0.953233
32 -4.829535 True 0.098237 0.896739
33 -4.144197 False 0.771199 1.000000
34 -5.484631 True 0.118123 0.839257
35 -2.936942 True 0.045030 1.000000
36 -4.046434 True 0.076106 0.957551
37 -3.222275 True 0.053322 1.000000
38 -2.669231 True 0.037631 1.000000
39 -5.665103 True 0.117253 0.799496
40 -4.398080 True 0.085866 0.931436
41 -4.988127 True 0.102896 0.883221
42 -6.073295 False 0.751665 0.586191
43 -6.556971 False 0.740877 0.519846
44 -4.606470 True 0.091791 0.915087
45 -1.422571 True 0.005923 1.000000
46 -1.755600 True 0.014125 1.000000
47 -1.924661 True 0.018337 1.000000
48 -3.593833 True 0.063861 0.987749
49 -1.260392 True 0.001955 1.000000
##############################################
Get the Best Trial#
best_fitted_trials uses the data to do a fitting from all trials and with the noise levels you provided (or if no noise levels was provided, it assumed an unknown level of noise and inferred the noise level from the trial runs)
1trial = scheduler.best_fitted_trials()
2trial
[INFO 08-11 16:15:43] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
{8: {'params': {'x0': 0.0, 'x1': 1.0},
'means': {'branin': -17.505945227405267, 'currin': -1.1800724422942546},
'cov_matrix': {'branin': {'branin': 0.00012023265494986585, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 3.4215983343603906e-06}}},
11: {'params': {'x0': 0.06906385213397573, 'x1': 1.0},
'means': {'branin': -3.903812630871773, 'currin': -3.7154634426667297},
'cov_matrix': {'branin': {'branin': 0.00013142916730788339, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.8982432340301565e-06}}},
13: {'params': {'x0': 0.034186630805364486, 'x1': 1.0},
'means': {'branin': -8.40768503829646, 'currin': -2.540763231582426},
'cov_matrix': {'branin': {'branin': 6.083126848733594e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.5175207539229486e-06}}},
14: {'params': {'x0': 0.01624975399076722, 'x1': 1.0},
'means': {'branin': -12.647392343695671, 'currin': -1.8411125811275206},
'cov_matrix': {'branin': {'branin': 3.954156092970822e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.1282083383696302e-06}}},
16: {'params': {'x0': 0.049060805446934315, 'x1': 1.0},
'means': {'branin': -5.856158056291314, 'currin': -3.0776762095751473},
'cov_matrix': {'branin': {'branin': 6.210798337805355e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.5467571307900758e-06}}},
17: {'params': {'x0': 0.024833427368763022, 'x1': 1.0},
'means': {'branin': -10.46544055786319, 'currin': -2.181499576529845},
'cov_matrix': {'branin': {'branin': 6.0971966478685124e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.4120314891212182e-06}}},
18: {'params': {'x0': 0.007940803723628528, 'x1': 1.0},
'means': {'branin': -15.01806505528694, 'currin': -1.5050423076882962},
'cov_matrix': {'branin': {'branin': 4.8864391244996814e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.1909031214444688e-06}}},
20: {'params': {'x0': 0.057975498664321105, 'x1': 1.0},
'means': {'branin': -4.771091747100799, 'currin': -3.3748538428978616},
'cov_matrix': {'branin': {'branin': 9.175802813278856e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.08806199364513e-06}}},
21: {'params': {'x0': 0.003929274104519794, 'x1': 1.0},
'means': {'branin': -16.24963476501897, 'currin': -1.341231959765277},
'cov_matrix': {'branin': {'branin': 4.27553624202844e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.261878918871537e-06}}},
22: {'params': {'x0': 0.04123953139082174, 'x1': 1.0},
'means': {'branin': -7.084891600239091, 'currin': -2.8012518691298407},
'cov_matrix': {'branin': {'branin': 5.695338826739095e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.444574315986758e-06}}},
23: {'params': {'x0': 0.02046158544217996, 'x1': 1.0},
'means': {'branin': -11.54231067921858, 'currin': -2.009189258336992},
'cov_matrix': {'branin': {'branin': 4.758874094961705e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.2109268546207584e-06}}},
24: {'params': {'x0': 0.08404250765038519, 'x1': 0.9609125859106751},
'means': {'branin': -2.491508986863437, 'currin': -4.248953306195816},
'cov_matrix': {'branin': {'branin': 0.00012208390357932065, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.3985765658183747e-06}}},
25: {'params': {'x0': 0.029393340733344906, 'x1': 1.0},
'means': {'branin': -9.419765535627795, 'currin': -2.3584139111669034},
'cov_matrix': {'branin': {'branin': 6.582397033188641e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.5398811121439316e-06}}},
26: {'params': {'x0': 0.07072364270399466, 'x1': 0.9713504293958559},
'means': {'branin': -3.3796638104825654, 'currin': -3.8485861437965263},
'cov_matrix': {'branin': {'branin': 0.00011894171247705809, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.2603091807210017e-06}}},
27: {'params': {'x0': 0.01203481294338811, 'x1': 1.0},
'means': {'branin': -13.818773522532027, 'currin': -1.67126513574097},
'cov_matrix': {'branin': {'branin': 4.4116585276764034e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.196930238776462e-06}}},
28: {'params': {'x0': 0.060190166454409874, 'x1': 0.9761105751599578},
'means': {'branin': -4.463586259828697, 'currin': -3.5104339088007084},
'cov_matrix': {'branin': {'branin': 0.000163357957019091, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 4.133213706828748e-06}}},
30: {'params': {'x0': 0.10813874837867996, 'x1': 0.8684533876115557},
'means': {'branin': -0.695000942608818, 'currin': -5.1606571365013},
'cov_matrix': {'branin': {'branin': 0.00015941846617883453, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 3.8104994250425995e-06}}},
32: {'params': {'x0': 0.0982373798237171, 'x1': 0.8967386580276616},
'means': {'branin': -1.1542997823896322, 'currin': -4.829585563177904},
'cov_matrix': {'branin': {'branin': 0.00012143879364468433, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.5845718048192752e-06}}},
34: {'params': {'x0': 0.11812266864978069, 'x1': 0.8392568255734573},
'means': {'branin': -0.4453368201774133, 'currin': -5.485105403751853},
'cov_matrix': {'branin': {'branin': 0.00018300225277709508, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 6.241090825901593e-06}}},
35: {'params': {'x0': 0.04502958435925066, 'x1': 1.0},
'means': {'branin': -6.457723274767528, 'currin': -2.9369366873086356},
'cov_matrix': {'branin': {'branin': 5.941996757890458e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.4669367060818205e-06}}},
36: {'params': {'x0': 0.07610631091681286, 'x1': 0.9575514390092708},
'means': {'branin': -2.8509795542925627, 'currin': -4.0463723636842595},
'cov_matrix': {'branin': {'branin': 0.0001287299584670755, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.7208387526072293e-06}}},
37: {'params': {'x0': 0.05332225106092659, 'x1': 1.0},
'means': {'branin': -5.294891198025377, 'currin': -3.2222217699950972},
'cov_matrix': {'branin': {'branin': 6.810405235962622e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.7296007401563867e-06}}},
38: {'params': {'x0': 0.03763101601193845, 'x1': 1.0},
'means': {'branin': -7.736631852987192, 'currin': -2.6692151050366717},
'cov_matrix': {'branin': {'branin': 5.700648919162496e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.4679412417152858e-06}}},
40: {'params': {'x0': 0.0858664317409115, 'x1': 0.9314355076781369},
'means': {'branin': -1.9984031396807218, 'currin': -4.397976425819566},
'cov_matrix': {'branin': {'branin': 0.0001466579838932199, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 3.195933075241665e-06}}},
41: {'params': {'x0': 0.10289633818319328, 'x1': 0.8832205614714647},
'means': {'branin': -0.9122552711715457, 'currin': -4.988039904981511},
'cov_matrix': {'branin': {'branin': 0.00011425945603328278, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.661081257554164e-06}}},
44: {'params': {'x0': 0.09179123391114485, 'x1': 0.9150866912652509},
'means': {'branin': -1.5595751896239562, 'currin': -4.6064623708802985},
'cov_matrix': {'branin': {'branin': 0.00012824357315657708, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.74294315498722e-06}}},
45: {'params': {'x0': 0.005923105768633833, 'x1': 1.0},
'means': {'branin': -15.630752599838242, 'currin': -1.4227521109912904},
'cov_matrix': {'branin': {'branin': 4.645817077505298e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.1562396149408355e-06}}},
46: {'params': {'x0': 0.014125154098707371, 'x1': 1.0},
'means': {'branin': -13.229716462100086, 'currin': -1.755681595330611},
'cov_matrix': {'branin': {'branin': 4.065142589176581e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.1543323664912675e-06}}},
47: {'params': {'x0': 0.0183371960984765, 'x1': 1.0},
'means': {'branin': -12.09146582984475, 'currin': -1.924642673669978},
'cov_matrix': {'branin': {'branin': 4.194450675829635e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.1457770310504329e-06}}},
48: {'params': {'x0': 0.06386124880839572, 'x1': 0.9877489353196072},
'means': {'branin': -4.106730766510445, 'currin': -3.593905254472366},
'cov_matrix': {'branin': {'branin': 0.00010819452229388578, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.7755188393903535e-06}}},
49: {'params': {'x0': 0.001954822840709279, 'x1': 1.0},
'means': {'branin': -16.87507553107477, 'currin': -1.2603271498374258},
'cov_matrix': {'branin': {'branin': 5.266332345433114e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.8311199882963652e-06}}}}
if you need the exact points of the best trial, maybe because you need the trial number of the best trial to plot results, or for any other reason, best_raw_trails does not do any fitting
1trial = scheduler.best_raw_trials()
2trial
[INFO 08-11 16:15:43] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
{8: {'params': {'x0': 0.0, 'x1': 1.0},
'means': {'branin': -17.508296966552734, 'currin': -1.180408000946045},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
11: {'params': {'x0': 0.06906385213397573, 'x1': 1.0},
'means': {'branin': -3.9034695625305176, 'currin': -3.7155561447143555},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
13: {'params': {'x0': 0.034186630805364486, 'x1': 1.0},
'means': {'branin': -8.407588958740234, 'currin': -2.5408003330230713},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
14: {'params': {'x0': 0.01624975399076722, 'x1': 1.0},
'means': {'branin': -12.647773742675781, 'currin': -1.8410851955413818},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
16: {'params': {'x0': 0.049060805446934315, 'x1': 1.0},
'means': {'branin': -5.8564372062683105, 'currin': -3.0776994228363037},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
17: {'params': {'x0': 0.024833427368763022, 'x1': 1.0},
'means': {'branin': -10.465502738952637, 'currin': -2.1815829277038574},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
18: {'params': {'x0': 0.007940803723628528, 'x1': 1.0},
'means': {'branin': -15.01707935333252, 'currin': -1.504840612411499},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
20: {'params': {'x0': 0.057975498664321105, 'x1': 1.0},
'means': {'branin': -4.771063327789307, 'currin': -3.374941349029541},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
21: {'params': {'x0': 0.003929274104519794, 'x1': 1.0},
'means': {'branin': -16.248422622680664, 'currin': -1.3411325216293335},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
22: {'params': {'x0': 0.04123953139082174, 'x1': 1.0},
'means': {'branin': -7.084921836853027, 'currin': -2.8012547492980957},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
23: {'params': {'x0': 0.02046158544217996, 'x1': 1.0},
'means': {'branin': -11.542601585388184, 'currin': -2.009241819381714},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
24: {'params': {'x0': 0.08404250765038519, 'x1': 0.9609125859106751},
'means': {'branin': -2.4932241439819336, 'currin': -4.248926162719727},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
25: {'params': {'x0': 0.029393340733344906, 'x1': 1.0},
'means': {'branin': -9.41968059539795, 'currin': -2.3584847450256348},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
26: {'params': {'x0': 0.07072364270399466, 'x1': 0.9713504293958559},
'means': {'branin': -3.381143569946289, 'currin': -3.8485584259033203},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
27: {'params': {'x0': 0.01203481294338811, 'x1': 1.0},
'means': {'branin': -13.81873607635498, 'currin': -1.6711283922195435},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
28: {'params': {'x0': 0.060190166454409874, 'x1': 0.9761105751599578},
'means': {'branin': -4.460362911224365, 'currin': -3.510225772857666},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
30: {'params': {'x0': 0.10813874837867996, 'x1': 0.8684533876115557},
'means': {'branin': -0.6959819793701172, 'currin': -5.161031246185303},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
32: {'params': {'x0': 0.0982373798237171, 'x1': 0.8967386580276616},
'means': {'branin': -1.1540794372558594, 'currin': -4.829535007476807},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
34: {'params': {'x0': 0.11812266864978069, 'x1': 0.8392568255734573},
'means': {'branin': -0.4448356628417969, 'currin': -5.484630584716797},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
35: {'params': {'x0': 0.04502958435925066, 'x1': 1.0},
'means': {'branin': -6.457882404327393, 'currin': -2.936941623687744},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
36: {'params': {'x0': 0.07610631091681286, 'x1': 0.9575514390092708},
'means': {'branin': -2.850466251373291, 'currin': -4.04643440246582},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
37: {'params': {'x0': 0.05332225106092659, 'x1': 1.0},
'means': {'branin': -5.295164108276367, 'currin': -3.222275495529175},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
38: {'params': {'x0': 0.03763101601193845, 'x1': 1.0},
'means': {'branin': -7.736581802368164, 'currin': -2.6692306995391846},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
40: {'params': {'x0': 0.0858664317409115, 'x1': 0.9314355076781369},
'means': {'branin': -1.9985685348510742, 'currin': -4.398080348968506},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
41: {'params': {'x0': 0.10289633818319328, 'x1': 0.8832205614714647},
'means': {'branin': -0.9116716384887695, 'currin': -4.9881272315979},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
44: {'params': {'x0': 0.09179123391114485, 'x1': 0.9150866912652509},
'means': {'branin': -1.5595521926879883, 'currin': -4.606469631195068},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
45: {'params': {'x0': 0.005923105768633833, 'x1': 1.0},
'means': {'branin': -15.629409790039062, 'currin': -1.422571063041687},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
46: {'params': {'x0': 0.014125154098707371, 'x1': 1.0},
'means': {'branin': -13.229970932006836, 'currin': -1.7555996179580688},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
47: {'params': {'x0': 0.0183371960984765, 'x1': 1.0},
'means': {'branin': -12.091843605041504, 'currin': -1.9246606826782227},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
48: {'params': {'x0': 0.06386124880839572, 'x1': 0.9877489353196072},
'means': {'branin': -4.109103679656982, 'currin': -3.5938334465026855},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
49: {'params': {'x0': 0.001954822840709279, 'x1': 1.0},
'means': {'branin': -16.874921798706055, 'currin': -1.260392189025879},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}}}
Output All Trials#
1boa.scheduler_to_df(scheduler)
| trial_index | arm_name | trial_status | generation_method | branin | currin | is_feasible | x0 | x1 | |
|---|---|---|---|---|---|---|---|---|---|
| 0 | 0 | 0_0 | COMPLETED | Sobol | -47.393387 | -12.803135 | False | 0.220653 | 0.190085 |
| 1 | 1 | 1_0 | COMPLETED | Sobol | -60.196510 | -6.039466 | False | 0.544447 | 0.665884 |
| 2 | 2 | 2_0 | COMPLETED | Sobol | -17.071615 | -7.848244 | False | 0.893388 | 0.348009 |
| 3 | 3 | 3_0 | COMPLETED | Sobol | -22.292170 | -8.111297 | False | 0.394978 | 0.479361 |
| 4 | 4 | 4_0 | COMPLETED | Sobol | -90.586082 | -10.508014 | False | 0.107982 | 0.224903 |
| 5 | 5 | 5_0 | COMPLETED | MOO | -78.735092 | -4.911559 | False | 0.969763 | 0.761758 |
| 6 | 6 | 6_0 | COMPLETED | MOO | -50.011749 | -5.978871 | False | 0.291261 | 0.849037 |
| 7 | 7 | 7_0 | COMPLETED | MOO | -9.294098 | -10.188202 | False | 0.989131 | 0.000000 |
| 8 | 8 | 8_0 | COMPLETED | MOO | -17.508297 | -1.180408 | True | 0.000000 | 1.000000 |
| 9 | 9 | 9_0 | COMPLETED | MOO | -31.137854 | -1.322935 | False | 0.000000 | 0.859746 |
| 10 | 10 | 10_0 | COMPLETED | MOO | -72.980576 | -1.646299 | False | 0.000000 | 0.628322 |
| 11 | 11 | 11_0 | COMPLETED | MOO | -3.903470 | -3.715556 | True | 0.069064 | 1.000000 |
| 12 | 12 | 12_0 | COMPLETED | MOO | -6.587681 | -4.791344 | True | 0.117075 | 1.000000 |
| 13 | 13 | 13_0 | COMPLETED | MOO | -8.407589 | -2.540800 | True | 0.034187 | 1.000000 |
| 14 | 14 | 14_0 | COMPLETED | MOO | -12.647774 | -1.841085 | True | 0.016250 | 1.000000 |
| 15 | 15 | 15_0 | COMPLETED | MOO | -11.842781 | -10.933602 | False | 0.647254 | 0.000000 |
| 16 | 16 | 16_0 | COMPLETED | MOO | -5.856437 | -3.077699 | True | 0.049061 | 1.000000 |
| 17 | 17 | 17_0 | COMPLETED | MOO | -10.465503 | -2.181583 | True | 0.024833 | 1.000000 |
| 18 | 18 | 18_0 | COMPLETED | MOO | -15.017079 | -1.504841 | True | 0.007941 | 1.000000 |
| 19 | 19 | 19_0 | COMPLETED | MOO | -3.590695 | -3.997228 | True | 0.079210 | 1.000000 |
| 20 | 20 | 20_0 | COMPLETED | MOO | -4.771063 | -3.374941 | True | 0.057975 | 1.000000 |
| 21 | 21 | 21_0 | COMPLETED | MOO | -16.248423 | -1.341133 | True | 0.003929 | 1.000000 |
| 22 | 22 | 22_0 | COMPLETED | MOO | -7.084922 | -2.801255 | True | 0.041240 | 1.000000 |
| 23 | 23 | 23_0 | COMPLETED | MOO | -11.542602 | -2.009242 | True | 0.020462 | 1.000000 |
| 24 | 24 | 24_0 | COMPLETED | MOO | -2.493224 | -4.248926 | True | 0.084043 | 0.960913 |
| 25 | 25 | 25_0 | COMPLETED | MOO | -9.419681 | -2.358485 | True | 0.029393 | 1.000000 |
| 26 | 26 | 26_0 | COMPLETED | MOO | -3.381144 | -3.848558 | True | 0.070724 | 0.971350 |
| 27 | 27 | 27_0 | COMPLETED | MOO | -13.818736 | -1.671128 | True | 0.012035 | 1.000000 |
| 28 | 28 | 28_0 | COMPLETED | MOO | -4.460363 | -3.510226 | True | 0.060190 | 0.976111 |
| 29 | 29 | 29_0 | COMPLETED | MOO | -1.730358 | -4.616930 | True | 0.095243 | 0.933960 |
| 30 | 30 | 30_0 | COMPLETED | MOO | -0.695982 | -5.161031 | True | 0.108139 | 0.868453 |
| 31 | 31 | 31_0 | COMPLETED | MOO | -2.192480 | -4.450382 | True | 0.091114 | 0.953233 |
| 32 | 32 | 32_0 | COMPLETED | MOO | -1.154079 | -4.829535 | True | 0.098237 | 0.896739 |
| 33 | 33 | 33_0 | COMPLETED | MOO | -211.882339 | -4.144197 | False | 0.771199 | 1.000000 |
| 34 | 34 | 34_0 | COMPLETED | MOO | -0.444836 | -5.484631 | True | 0.118123 | 0.839257 |
| 35 | 35 | 35_0 | COMPLETED | MOO | -6.457882 | -2.936942 | True | 0.045030 | 1.000000 |
| 36 | 36 | 36_0 | COMPLETED | MOO | -2.850466 | -4.046434 | True | 0.076106 | 0.957551 |
| 37 | 37 | 37_0 | COMPLETED | MOO | -5.295164 | -3.222275 | True | 0.053322 | 1.000000 |
| 38 | 38 | 38_0 | COMPLETED | MOO | -7.736582 | -2.669231 | True | 0.037631 | 1.000000 |
| 39 | 39 | 39_0 | COMPLETED | MOO | -0.719290 | -5.665103 | True | 0.117253 | 0.799496 |
| 40 | 40 | 40_0 | COMPLETED | MOO | -1.998569 | -4.398080 | True | 0.085866 | 0.931436 |
| 41 | 41 | 41_0 | COMPLETED | MOO | -0.911672 | -4.988127 | True | 0.102896 | 0.883221 |
| 42 | 42 | 42_0 | COMPLETED | MOO | -78.785782 | -6.073295 | False | 0.751665 | 0.586191 |
| 43 | 43 | 43_0 | COMPLETED | MOO | -64.345276 | -6.556971 | False | 0.740877 | 0.519846 |
| 44 | 44 | 44_0 | COMPLETED | MOO | -1.559552 | -4.606470 | True | 0.091791 | 0.915087 |
| 45 | 45 | 45_0 | COMPLETED | MOO | -15.629410 | -1.422571 | True | 0.005923 | 1.000000 |
| 46 | 46 | 46_0 | COMPLETED | MOO | -13.229971 | -1.755600 | True | 0.014125 | 1.000000 |
| 47 | 47 | 47_0 | COMPLETED | MOO | -12.091844 | -1.924661 | True | 0.018337 | 1.000000 |
| 48 | 48 | 48_0 | COMPLETED | MOO | -4.109104 | -3.593833 | True | 0.063861 | 0.987749 |
| 49 | 49 | 49_0 | COMPLETED | MOO | -16.874922 | -1.260392 | True | 0.001955 | 1.000000 |