Running a Multi Objective Optimization Directly in Python#
This notebook demonstrates how to:
Write a basic Wrapper in Python and launch a multi objective optimization from Python. If you wanted to launch it from command line, you would do a similar thing of defining the Wrapper, and then put in your configuration file the information about where the wrapper is, and use BOA’s CLI tools. See Running an Experiment from Command Line (Python Wrapper) for more information.
1import pathlib
2import shutil
3
4from IPython.display import Code
5
6import boa
7from boa.scripts.moo import Wrapper
[WARNING 07-13 14:31:07] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via `pip install ax-platform[mysql]`.
Show code cell content
1# Remove old runs to have a clean slate for this example
2old_runs = pathlib.Path().resolve().glob("moo_run*")
3for path in old_runs:
4 shutil.rmtree(path, ignore_errors=True)
Loading the MOO Config File#
1config_path = pathlib.Path().resolve().parent.parent / "boa/scripts/moo.yaml"
Here we can see what the configuration file looks like
1Code(config_path)
# MultiObjective Optimization config
optimization_options:
objective_options:
objective_thresholds:
- branin >= -18.0
- currin >= -6.0
objectives:
- name: branin
lower_is_better: False
noise_sd: 0
- name: currin
lower_is_better: False
noise_sd: 0
experiment:
name: "moo_run"
trials: 50
parameters:
x0:
type: range
bounds: [0, 1]
value_type: float
x1:
type: range
bounds: [0, 1]
value_type: float
1config = boa.load_jsonlike(config_path)
The Wrapper#
We define our wrapper in wrapper.py and use a synthetic function that stands in for any black box model call
1Code(Wrapper.path())
from pathlib import Path
import torch
from boa.controller import Controller
from boa.metrics.synthetic_funcs import get_synth_func
from boa.utils import torch_device
from boa.wrappers.base_wrapper import BaseWrapper
tkwargs = {
"device": torch_device(),
}
Problem = get_synth_func("BraninCurrin")
problem = Problem(negate=True).to(**tkwargs)
class Wrapper(BaseWrapper):
def run_model(self, trial) -> None:
pass
def set_trial_status(self, trial) -> None:
trial.mark_completed()
def fetch_trial_data(self, trial, metric_properties, metric_name, *args, **kwargs):
evaluation = problem(torch.tensor([trial.arm.parameters["x0"], trial.arm.parameters["x1"]]))
a = float(evaluation[0])
b = float(evaluation[1])
return {"branin": a, "currin": b}
def main():
config_path = Path(__file__).resolve().parent / "moo.yaml"
wrapper = Wrapper(config_path=config_path)
controller = Controller(wrapper=wrapper)
controller.initialize_scheduler()
return controller.run()
if __name__ == "__main__":
main()
The Setup#
1controller = boa.Controller(config_path=config_path, wrapper=Wrapper)
2
3controller.initialize_scheduler()
[INFO 07-13 14:31:09] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x0', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[]).
[INFO 07-13 14:31:09] ax.modelbridge.dispatch_utils: Using Models.MOO since there are more ordered parameters than there are categories for the unordered categorical parameters.
[INFO 07-13 14:31:09] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=2 num_trials=None use_batch_trials=False
[INFO 07-13 14:31:09] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=5
[INFO 07-13 14:31:09] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=5
[INFO 07-13 14:31:09] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+MOO', steps=[Sobol for 5 trials, MOO for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.
[INFO 07-13 14:31:09] Scheduler: `Scheduler` requires experiment to have immutable search space and optimization config. Setting property immutable_search_space_and_opt_config to `True` on experiment.
(Scheduler(experiment=Experiment(moo_run), generation_strategy=GenerationStrategy(name='Sobol+MOO', steps=[Sobol for 5 trials, MOO for subsequent trials]), options=SchedulerOptions(max_pending_trials=10, trial_type=<TrialType.TRIAL: 0>, batch_size=None, total_trials=None, tolerated_trial_failure_rate=0.5, min_failed_trials_for_failure_rate_check=5, log_filepath=None, logging_level=20, ttl_seconds_for_trials=None, init_seconds_between_polls=1, min_seconds_before_poll=1.0, seconds_between_polls_backoff_factor=1.5, timeout_hours=None, run_trials_in_batches=False, debug_log_run_metadata=False, early_stopping_strategy=None, global_stopping_strategy=None, suppress_storage_errors_after_retries=False)),
<boa.scripts.moo.Wrapper at 0x1691f7fa0>)
Start our Experiment#
The Controller will save our scheduler to JSON after it completes the run so we can reload it at a later time for analysis or to resume our experiment
1scheduler = controller.run()
[INFO 2023-07-13 14:31:09,060 MainProcess] boa:
##############################################
BOA Experiment Run
Output Experiment Dir: /Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109
Start Time: 20230713T143109
Version: 0.8.7.dev4+gae30cf2.d20230713
##############################################
[INFO 07-13 14:31:09] Scheduler: Running trials [0]...
[INFO 07-13 14:31:10] Scheduler: Running trials [1]...
[INFO 07-13 14:31:11] Scheduler: Running trials [2]...
[INFO 07-13 14:31:12] Scheduler: Running trials [3]...
[INFO 07-13 14:31:13] Scheduler: Running trials [4]...
[INFO 07-13 14:31:14] Scheduler: Generated all trials that can be generated currently. Model requires more data to generate more trials.
[INFO 07-13 14:31:14] Scheduler: Retrieved COMPLETED trials: 0 - 4.
[INFO 07-13 14:31:14] Scheduler: Fetching data for trials: 0 - 4.
[ERROR 2023-07-13 14:31:14,208 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:31:14,222 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:31:14,327 MainProcess] boa: Trials so far: 5
Running trials:
Will Produce next trials from generation step: Sobol
Best trial so far: {}
[INFO 07-13 14:31:14] Scheduler: Running trials [5]...
[INFO 07-13 14:31:15] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:16] Scheduler: Running trials [6]...
[INFO 07-13 14:31:16] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:17] Scheduler: Running trials [7]...
[INFO 07-13 14:31:17] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:17] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:31:17] Scheduler: Retrieved COMPLETED trials: 5 - 7.
[INFO 07-13 14:31:17] Scheduler: Fetching data for trials: 5 - 7.
[ERROR 2023-07-13 14:31:17,762 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:31:17,777 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:31:17,851 MainProcess] boa: Trials so far: 8
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203}}
[INFO 07-13 14:31:17] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:18] Scheduler: Running trials [8]...
[INFO 07-13 14:31:19] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:20] Scheduler: Running trials [9]...
[INFO 07-13 14:31:21] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:21] Scheduler: Running trials [10]...
[INFO 07-13 14:31:22] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:22] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:31:22] Scheduler: Retrieved COMPLETED trials: 8 - 10.
[INFO 07-13 14:31:22] Scheduler: Fetching data for trials: 8 - 10.
[ERROR 2023-07-13 14:31:22,925 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:31:22,939 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:31:23,001 MainProcess] boa: Trials so far: 11
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
10: {'branin': -2.751490592956543, 'currin': -4.412967205047607}}
[INFO 07-13 14:31:23] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:23] Scheduler: Running trials [11]...
[INFO 07-13 14:31:24] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:25] Scheduler: Running trials [12]...
[INFO 07-13 14:31:26] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:27] Scheduler: Running trials [13]...
[INFO 07-13 14:31:27] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:27] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:31:27] Scheduler: Retrieved COMPLETED trials: 11 - 13.
[INFO 07-13 14:31:27] Scheduler: Fetching data for trials: 11 - 13.
[ERROR 2023-07-13 14:31:27,449 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:31:27,474 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:31:27,585 MainProcess] boa: Trials so far: 14
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
10: {'branin': -2.751490592956543, 'currin': -4.412967205047607},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
13: {'branin': -2.6974687576293945, 'currin': -4.486274719238281}}
[INFO 07-13 14:31:27] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:28] Scheduler: Running trials [14]...
[INFO 07-13 14:31:28] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:29] Scheduler: Running trials [15]...
[INFO 07-13 14:31:30] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:30] Scheduler: Running trials [16]...
[INFO 07-13 14:31:31] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:31] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:31:31] Scheduler: Retrieved COMPLETED trials: 14 - 16.
[INFO 07-13 14:31:31] Scheduler: Fetching data for trials: 14 - 16.
[ERROR 2023-07-13 14:31:31,676 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:31:31,699 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:31:31,785 MainProcess] boa: Trials so far: 17
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
10: {'branin': -2.751490592956543, 'currin': -4.412967205047607},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
13: {'branin': -2.6974687576293945, 'currin': -4.486274719238281},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492}}
[INFO 07-13 14:31:31] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:32] Scheduler: Running trials [17]...
[INFO 07-13 14:31:33] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:34] Scheduler: Running trials [18]...
[INFO 07-13 14:31:35] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:35] Scheduler: Running trials [19]...
[INFO 07-13 14:31:36] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:36] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:31:36] Scheduler: Retrieved COMPLETED trials: 17 - 19.
[INFO 07-13 14:31:36] Scheduler: Fetching data for trials: 17 - 19.
[ERROR 2023-07-13 14:31:36,708 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:31:36,737 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:31:36,844 MainProcess] boa: Trials so far: 20
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
10: {'branin': -2.751490592956543, 'currin': -4.412967205047607},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
13: {'branin': -2.6974687576293945, 'currin': -4.486274719238281},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066}}
[INFO 07-13 14:31:36] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:37] Scheduler: Running trials [20]...
[INFO 07-13 14:31:38] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:40] Scheduler: Running trials [21]...
[INFO 07-13 14:31:40] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:41] Scheduler: Running trials [22]...
[INFO 07-13 14:31:42] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:42] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:31:42] Scheduler: Retrieved COMPLETED trials: 20 - 22.
[INFO 07-13 14:31:42] Scheduler: Fetching data for trials: 20 - 22.
[ERROR 2023-07-13 14:31:42,129 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:31:42,163 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:31:42,255 MainProcess] boa: Trials so far: 23
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
10: {'branin': -2.751490592956543, 'currin': -4.412967205047607},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
13: {'branin': -2.6974687576293945, 'currin': -4.486274719238281},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
20: {'branin': -11.557344436645508, 'currin': -2.006943702697754},
21: {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
22: {'branin': -8.345803260803223, 'currin': -2.5523483753204346}}
[INFO 07-13 14:31:42] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:43] Scheduler: Running trials [23]...
[INFO 07-13 14:31:44] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:45] Scheduler: Running trials [24]...
[INFO 07-13 14:31:46] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:46] Scheduler: Running trials [25]...
[INFO 07-13 14:31:47] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:47] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:31:47] Scheduler: Retrieved COMPLETED trials: 23 - 25.
[INFO 07-13 14:31:47] Scheduler: Fetching data for trials: 23 - 25.
[ERROR 2023-07-13 14:31:47,775 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:31:47,809 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:31:47,897 MainProcess] boa: Trials so far: 26
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
20: {'branin': -11.557344436645508, 'currin': -2.006943702697754},
21: {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
22: {'branin': -8.345803260803223, 'currin': -2.5523483753204346},
23: {'branin': -5.791337966918945, 'currin': -3.093717575073242},
24: {'branin': -2.1616764068603516, 'currin': -4.326265811920166}}
[INFO 07-13 14:31:47] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:48] Scheduler: Running trials [26]...
[INFO 07-13 14:31:49] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:50] Scheduler: Running trials [27]...
[INFO 07-13 14:31:50] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:51] Scheduler: Running trials [28]...
[INFO 07-13 14:31:52] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:52] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:31:52] Scheduler: Retrieved COMPLETED trials: 26 - 28.
[INFO 07-13 14:31:52] Scheduler: Fetching data for trials: 26 - 28.
[ERROR 2023-07-13 14:31:52,577 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:31:52,615 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:31:52,717 MainProcess] boa: Trials so far: 29
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
20: {'branin': -11.557344436645508, 'currin': -2.006943702697754},
21: {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
22: {'branin': -8.345803260803223, 'currin': -2.5523483753204346},
23: {'branin': -5.791337966918945, 'currin': -3.093717575073242},
24: {'branin': -2.1616764068603516, 'currin': -4.326265811920166},
26: {'branin': -3.936014175415039, 'currin': -3.653069019317627},
27: {'branin': -10.64627456665039, 'currin': -2.152012586593628},
28: {'branin': -0.8413734436035156, 'currin': -5.042774677276611}}
[INFO 07-13 14:31:52] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:53] Scheduler: Running trials [29]...
[INFO 07-13 14:31:54] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:56] Scheduler: Running trials [30]...
[INFO 07-13 14:31:57] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:57] Scheduler: Running trials [31]...
[INFO 07-13 14:31:58] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:31:58] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:31:58] Scheduler: Retrieved COMPLETED trials: 29 - 31.
[INFO 07-13 14:31:58] Scheduler: Fetching data for trials: 29 - 31.
[ERROR 2023-07-13 14:31:58,966 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:31:59,007 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:31:59,112 MainProcess] boa: Trials so far: 32
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
20: {'branin': -11.557344436645508, 'currin': -2.006943702697754},
21: {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
22: {'branin': -8.345803260803223, 'currin': -2.5523483753204346},
23: {'branin': -5.791337966918945, 'currin': -3.093717575073242},
24: {'branin': -2.1616764068603516, 'currin': -4.326265811920166},
26: {'branin': -3.936014175415039, 'currin': -3.653069019317627},
27: {'branin': -10.64627456665039, 'currin': -2.152012586593628},
28: {'branin': -0.8413734436035156, 'currin': -5.042774677276611},
29: {'branin': -1.6735401153564453, 'currin': -4.550370693206787},
30: {'branin': -2.6767940521240234, 'currin': -4.113973617553711},
31: {'branin': -0.4042530059814453, 'currin': -5.611616134643555}}
[INFO 07-13 14:31:59] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:00] Scheduler: Running trials [32]...
[INFO 07-13 14:32:01] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:01] Scheduler: Running trials [33]...
[INFO 07-13 14:32:02] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:03] Scheduler: Running trials [34]...
[INFO 07-13 14:32:04] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:04] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:32:04] Scheduler: Retrieved COMPLETED trials: 32 - 34.
[INFO 07-13 14:32:04] Scheduler: Fetching data for trials: 32 - 34.
[ERROR 2023-07-13 14:32:04,803 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:32:04,848 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:32:04,960 MainProcess] boa: Trials so far: 35
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
20: {'branin': -11.557344436645508, 'currin': -2.006943702697754},
21: {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
22: {'branin': -8.345803260803223, 'currin': -2.5523483753204346},
23: {'branin': -5.791337966918945, 'currin': -3.093717575073242},
24: {'branin': -2.1616764068603516, 'currin': -4.326265811920166},
26: {'branin': -3.936014175415039, 'currin': -3.653069019317627},
27: {'branin': -10.64627456665039, 'currin': -2.152012586593628},
28: {'branin': -0.8413734436035156, 'currin': -5.042774677276611},
29: {'branin': -1.6735401153564453, 'currin': -4.550370693206787},
30: {'branin': -2.6767940521240234, 'currin': -4.113973617553711},
31: {'branin': -0.4042530059814453, 'currin': -5.611616134643555},
32: {'branin': -5.229813098907471, 'currin': -3.240206718444824},
33: {'branin': -16.462448120117188, 'currin': -1.313362956047058},
34: {'branin': -3.5601887702941895, 'currin': -3.784292221069336}}
[INFO 07-13 14:32:04] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:05] Scheduler: Running trials [35]...
[INFO 07-13 14:32:06] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:07] Scheduler: Running trials [36]...
[INFO 07-13 14:32:08] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:09] Scheduler: Running trials [37]...
[INFO 07-13 14:32:10] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:10] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:32:10] Scheduler: Retrieved COMPLETED trials: 35 - 37.
[INFO 07-13 14:32:10] Scheduler: Fetching data for trials: 35 - 37.
[ERROR 2023-07-13 14:32:10,350 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:32:10,398 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:32:10,499 MainProcess] boa: Trials so far: 38
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
20: {'branin': -11.557344436645508, 'currin': -2.006943702697754},
21: {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
22: {'branin': -8.345803260803223, 'currin': -2.5523483753204346},
23: {'branin': -5.791337966918945, 'currin': -3.093717575073242},
24: {'branin': -2.1616764068603516, 'currin': -4.326265811920166},
26: {'branin': -3.936014175415039, 'currin': -3.653069019317627},
27: {'branin': -10.64627456665039, 'currin': -2.152012586593628},
28: {'branin': -0.8413734436035156, 'currin': -5.042774677276611},
29: {'branin': -1.6735401153564453, 'currin': -4.550370693206787},
30: {'branin': -2.6767940521240234, 'currin': -4.113973617553711},
31: {'branin': -0.4042530059814453, 'currin': -5.611616134643555},
32: {'branin': -5.229813098907471, 'currin': -3.240206718444824},
33: {'branin': -16.462448120117188, 'currin': -1.313362956047058},
34: {'branin': -3.5601887702941895, 'currin': -3.784292221069336}}
[INFO 07-13 14:32:10] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:11] Scheduler: Running trials [38]...
[INFO 07-13 14:32:12] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:13] Scheduler: Running trials [39]...
[INFO 07-13 14:32:14] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:15] Scheduler: Running trials [40]...
[INFO 07-13 14:32:16] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:16] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:32:16] Scheduler: Retrieved COMPLETED trials: 38 - 40.
[INFO 07-13 14:32:16] Scheduler: Fetching data for trials: 38 - 40.
[ERROR 2023-07-13 14:32:16,104 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:32:16,156 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:32:16,275 MainProcess] boa: Trials so far: 41
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
20: {'branin': -11.557344436645508, 'currin': -2.006943702697754},
21: {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
22: {'branin': -8.345803260803223, 'currin': -2.5523483753204346},
23: {'branin': -5.791337966918945, 'currin': -3.093717575073242},
24: {'branin': -2.1616764068603516, 'currin': -4.326265811920166},
26: {'branin': -3.936014175415039, 'currin': -3.653069019317627},
27: {'branin': -10.64627456665039, 'currin': -2.152012586593628},
28: {'branin': -0.8413734436035156, 'currin': -5.042774677276611},
29: {'branin': -1.6735401153564453, 'currin': -4.550370693206787},
30: {'branin': -2.6767940521240234, 'currin': -4.113973617553711},
31: {'branin': -0.4042530059814453, 'currin': -5.611616134643555},
32: {'branin': -5.229813098907471, 'currin': -3.240206718444824},
33: {'branin': -16.462448120117188, 'currin': -1.313362956047058},
34: {'branin': -3.5601887702941895, 'currin': -3.784292221069336},
38: {'branin': -16.983062744140625, 'currin': -1.2466212511062622},
39: {'branin': -9.042816162109375, 'currin': -2.424952268600464},
40: {'branin': -7.668343544006348, 'currin': -2.6826891899108887}}
[INFO 07-13 14:32:16] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:17] Scheduler: Running trials [41]...
[INFO 07-13 14:32:18] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:19] Scheduler: Running trials [42]...
[INFO 07-13 14:32:20] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:21] Scheduler: Running trials [43]...
[INFO 07-13 14:32:22] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:22] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:32:22] Scheduler: Retrieved COMPLETED trials: 41 - 43.
[INFO 07-13 14:32:22] Scheduler: Fetching data for trials: 41 - 43.
[ERROR 2023-07-13 14:32:22,488 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:32:22,545 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:32:22,667 MainProcess] boa: Trials so far: 44
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
20: {'branin': -11.557344436645508, 'currin': -2.006943702697754},
21: {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
22: {'branin': -8.345803260803223, 'currin': -2.5523483753204346},
23: {'branin': -5.791337966918945, 'currin': -3.093717575073242},
24: {'branin': -2.1616764068603516, 'currin': -4.326265811920166},
26: {'branin': -3.936014175415039, 'currin': -3.653069019317627},
27: {'branin': -10.64627456665039, 'currin': -2.152012586593628},
28: {'branin': -0.8413734436035156, 'currin': -5.042774677276611},
29: {'branin': -1.6735401153564453, 'currin': -4.550370693206787},
30: {'branin': -2.6767940521240234, 'currin': -4.113973617553711},
31: {'branin': -0.4042530059814453, 'currin': -5.611616134643555},
32: {'branin': -5.229813098907471, 'currin': -3.240206718444824},
33: {'branin': -16.462448120117188, 'currin': -1.313362956047058},
34: {'branin': -3.5601887702941895, 'currin': -3.784292221069336},
38: {'branin': -16.983062744140625, 'currin': -1.2466212511062622},
39: {'branin': -9.042816162109375, 'currin': -2.424952268600464},
40: {'branin': -7.668343544006348, 'currin': -2.6826891899108887},
41: {'branin': -6.388263702392578, 'currin': -2.952639102935791},
42: {'branin': -4.3190178871154785, 'currin': -3.5232274532318115},
43: {'branin': -1.4436731338500977, 'currin': -4.667131423950195}}
[INFO 07-13 14:32:22] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:23] Scheduler: Running trials [44]...
[INFO 07-13 14:32:24] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:25] Scheduler: Running trials [45]...
[INFO 07-13 14:32:26] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:27] Scheduler: Running trials [46]...
[INFO 07-13 14:32:28] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:28] Scheduler: Generated all trials that can be generated currently. Max parallelism currently reached.
[INFO 07-13 14:32:28] Scheduler: Retrieved COMPLETED trials: 44 - 46.
[INFO 07-13 14:32:28] Scheduler: Fetching data for trials: 44 - 46.
[ERROR 2023-07-13 14:32:28,646 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:32:28,706 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:32:28,831 MainProcess] boa: Trials so far: 47
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
20: {'branin': -11.557344436645508, 'currin': -2.006943702697754},
21: {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
22: {'branin': -8.345803260803223, 'currin': -2.5523483753204346},
23: {'branin': -5.791337966918945, 'currin': -3.093717575073242},
24: {'branin': -2.1616764068603516, 'currin': -4.326265811920166},
26: {'branin': -3.936014175415039, 'currin': -3.653069019317627},
27: {'branin': -10.64627456665039, 'currin': -2.152012586593628},
28: {'branin': -0.8413734436035156, 'currin': -5.042774677276611},
29: {'branin': -1.6735401153564453, 'currin': -4.550370693206787},
30: {'branin': -2.6767940521240234, 'currin': -4.113973617553711},
31: {'branin': -0.4042530059814453, 'currin': -5.611616134643555},
32: {'branin': -5.229813098907471, 'currin': -3.240206718444824},
33: {'branin': -16.462448120117188, 'currin': -1.313362956047058},
34: {'branin': -3.5601887702941895, 'currin': -3.784292221069336},
38: {'branin': -16.983062744140625, 'currin': -1.2466212511062622},
39: {'branin': -9.042816162109375, 'currin': -2.424952268600464},
40: {'branin': -7.668343544006348, 'currin': -2.6826891899108887},
41: {'branin': -6.388263702392578, 'currin': -2.952639102935791},
42: {'branin': -4.3190178871154785, 'currin': -3.5232274532318115},
43: {'branin': -1.4436731338500977, 'currin': -4.667131423950195},
44: {'branin': -1.9134502410888672, 'currin': -4.4366374015808105},
45: {'branin': -14.428484916687012, 'currin': -1.5856086015701294},
46: {'branin': -2.416285514831543, 'currin': -4.218944549560547}}
[INFO 07-13 14:32:28] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:29] Scheduler: Running trials [47]...
[INFO 07-13 14:32:30] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:31] Scheduler: Running trials [48]...
[INFO 07-13 14:32:32] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 07-13 14:32:34] Scheduler: Running trials [49]...
[INFO 07-13 14:32:35] Scheduler: Retrieved COMPLETED trials: 47 - 49.
[INFO 07-13 14:32:35] Scheduler: Fetching data for trials: 47 - 49.
[ERROR 2023-07-13 14:32:35,062 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:32:35,128 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 2023-07-13 14:32:35,282 MainProcess] boa: Trials so far: 50
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
20: {'branin': -11.557344436645508, 'currin': -2.006943702697754},
21: {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
22: {'branin': -8.345803260803223, 'currin': -2.5523483753204346},
23: {'branin': -5.791337966918945, 'currin': -3.093717575073242},
24: {'branin': -2.1616764068603516, 'currin': -4.326265811920166},
26: {'branin': -3.936014175415039, 'currin': -3.653069019317627},
27: {'branin': -10.64627456665039, 'currin': -2.152012586593628},
28: {'branin': -0.8413734436035156, 'currin': -5.042774677276611},
29: {'branin': -1.6735401153564453, 'currin': -4.550370693206787},
30: {'branin': -2.6767940521240234, 'currin': -4.113973617553711},
31: {'branin': -0.4042530059814453, 'currin': -5.611616134643555},
32: {'branin': -5.229813098907471, 'currin': -3.240206718444824},
33: {'branin': -16.462448120117188, 'currin': -1.313362956047058},
34: {'branin': -3.5601887702941895, 'currin': -3.784292221069336},
38: {'branin': -16.983062744140625, 'currin': -1.2466212511062622},
39: {'branin': -9.042816162109375, 'currin': -2.424952268600464},
40: {'branin': -7.668343544006348, 'currin': -2.6826891899108887},
41: {'branin': -6.388263702392578, 'currin': -2.952639102935791},
42: {'branin': -4.3190178871154785, 'currin': -3.5232274532318115},
43: {'branin': -1.4436731338500977, 'currin': -4.667131423950195},
44: {'branin': -1.9134502410888672, 'currin': -4.4366374015808105},
45: {'branin': -14.428484916687012, 'currin': -1.5856086015701294},
46: {'branin': -2.416285514831543, 'currin': -4.218944549560547},
47: {'branin': -15.946688652038574, 'currin': -1.3806185722351074},
48: {'branin': -12.489206314086914, 'currin': -1.8647232055664062}}
[ERROR 2023-07-13 14:32:35,283 MainProcess] boa: Object <boa.scripts.moo.Wrapper object at 0x1691f7fa0> passed to `object_to_json` (of type <class 'boa.scripts.moo.Wrapper'>, module: boa.scripts.moo) is not registered with a corresponding encoder in ENCODER_REGISTRY.
[INFO 2023-07-13 14:32:35,357 MainProcess] boa: Saved JSON-serialized state of optimization to `/Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109/scheduler.json`.
Boa version: 0.8.7.dev4+gae30cf2.d20230713
[INFO 07-13 14:32:35] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
[INFO 2023-07-13 14:32:35,413 MainProcess] boa: Trials so far: 50
Running trials:
Will Produce next trials from generation step: MOO
Best trial so far: {5: {'branin': -4.707081317901611, 'currin': -3.395252227783203},
8: {'branin': -17.508296966552734, 'currin': -1.180408000946045},
11: {'branin': -9.756551742553711, 'currin': -2.300353765487671},
14: {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
15: {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
17: {'branin': -7.011050701141357, 'currin': -2.816755771636963},
18: {'branin': -3.212923526763916, 'currin': -3.917620897293091},
19: {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
20: {'branin': -11.557344436645508, 'currin': -2.006943702697754},
21: {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
22: {'branin': -8.345803260803223, 'currin': -2.5523483753204346},
23: {'branin': -5.791337966918945, 'currin': -3.093717575073242},
24: {'branin': -2.1616764068603516, 'currin': -4.326265811920166},
26: {'branin': -3.936014175415039, 'currin': -3.653069019317627},
27: {'branin': -10.64627456665039, 'currin': -2.152012586593628},
28: {'branin': -0.8413734436035156, 'currin': -5.042774677276611},
29: {'branin': -1.6735401153564453, 'currin': -4.550370693206787},
30: {'branin': -2.6767940521240234, 'currin': -4.113973617553711},
31: {'branin': -0.4042530059814453, 'currin': -5.611616134643555},
32: {'branin': -5.229813098907471, 'currin': -3.240206718444824},
33: {'branin': -16.462448120117188, 'currin': -1.313362956047058},
34: {'branin': -3.5601887702941895, 'currin': -3.784292221069336},
38: {'branin': -16.983062744140625, 'currin': -1.2466212511062622},
39: {'branin': -9.042816162109375, 'currin': -2.424952268600464},
40: {'branin': -7.668343544006348, 'currin': -2.6826891899108887},
41: {'branin': -6.388263702392578, 'currin': -2.952639102935791},
42: {'branin': -4.3190178871154785, 'currin': -3.5232274532318115},
43: {'branin': -1.4436731338500977, 'currin': -4.667131423950195},
44: {'branin': -1.9134502410888672, 'currin': -4.4366374015808105},
45: {'branin': -14.428484916687012, 'currin': -1.5856086015701294},
46: {'branin': -2.416285514831543, 'currin': -4.218944549560547},
47: {'branin': -15.946688652038574, 'currin': -1.3806185722351074},
48: {'branin': -12.489206314086914, 'currin': -1.8647232055664062}}
[INFO 2023-07-13 14:32:35,440 MainProcess] boa:
##############################################
Trials Completed!
BOA Experiment Run
Output Experiment Dir: /Users/madelinescyphers/Documents/projs_.nosync/boa/docs/examples/moo_run_20230713T143109
Start Time: 20230713T143109
Version: 0.8.7.dev4+gae30cf2.d20230713
End Time: 20230713T143235
Total Run Time: 86.35451197624207
trial_index arm_name trial_status generation_method branin \
0 0 0_0 COMPLETED Sobol -109.987946
1 1 1_0 COMPLETED Sobol -2.655920
2 2 2_0 COMPLETED Sobol -35.314487
3 3 3_0 COMPLETED Sobol -51.288143
4 4 4_0 COMPLETED Sobol -0.992895
5 5 5_0 COMPLETED MOO -4.707081
6 6 6_0 COMPLETED MOO -10.960894
7 7 7_0 COMPLETED MOO -55.937115
8 8 8_0 COMPLETED MOO -17.508297
9 9 9_0 COMPLETED MOO -26.455505
10 10 10_0 COMPLETED MOO -2.751491
11 11 11_0 COMPLETED MOO -9.756552
12 12 12_0 COMPLETED MOO -167.167480
13 13 13_0 COMPLETED MOO -2.697469
14 14 14_0 COMPLETED MOO -13.439867
15 15 15_0 COMPLETED MOO -1.229228
16 16 16_0 COMPLETED MOO -308.129059
17 17 17_0 COMPLETED MOO -7.011051
18 18 18_0 COMPLETED MOO -3.212924
19 19 19_0 COMPLETED MOO -0.542315
20 20 20_0 COMPLETED MOO -11.557344
21 21 21_0 COMPLETED MOO -15.435509
22 22 22_0 COMPLETED MOO -8.345803
23 23 23_0 COMPLETED MOO -5.791338
24 24 24_0 COMPLETED MOO -2.161676
25 25 25_0 COMPLETED MOO -145.872208
26 26 26_0 COMPLETED MOO -3.936014
27 27 27_0 COMPLETED MOO -10.646275
28 28 28_0 COMPLETED MOO -0.841373
29 29 29_0 COMPLETED MOO -1.673540
30 30 30_0 COMPLETED MOO -2.676794
31 31 31_0 COMPLETED MOO -0.404253
32 32 32_0 COMPLETED MOO -5.229813
33 33 33_0 COMPLETED MOO -16.462448
34 34 34_0 COMPLETED MOO -3.560189
35 35 35_0 COMPLETED MOO -212.371979
36 36 36_0 COMPLETED MOO -105.502625
37 37 37_0 COMPLETED MOO -65.481857
38 38 38_0 COMPLETED MOO -16.983063
39 39 39_0 COMPLETED MOO -9.042816
40 40 40_0 COMPLETED MOO -7.668344
41 41 41_0 COMPLETED MOO -6.388264
42 42 42_0 COMPLETED MOO -4.319018
43 43 43_0 COMPLETED MOO -1.443673
44 44 44_0 COMPLETED MOO -1.913450
45 45 45_0 COMPLETED MOO -14.428485
46 46 46_0 COMPLETED MOO -2.416286
47 47 47_0 COMPLETED MOO -15.946689
48 48 48_0 COMPLETED MOO -12.489206
49 49 49_0 COMPLETED MOO -52.128422
currin is_feasible x0 x1
0 -4.971244 False 0.856628 0.764265
1 -7.005593 False 0.157682 0.671000
2 -12.795367 False 0.357816 0.092607
3 -2.498643 False 0.016990 0.670656
4 -10.797516 False 0.562803 0.163890
5 -3.395252 True 0.058608 1.000000
6 -10.179487 False 1.000000 0.000000
7 -5.405636 False 0.243453 1.000000
8 -1.180408 True 0.000000 1.000000
9 -1.280036 False 0.000000 0.898782
10 -4.412967 True 0.080315 0.885963
11 -2.300354 True 0.027886 1.000000
12 -4.468507 False 0.558653 1.000000
13 -4.486275 True 0.095033 0.968575
14 -1.725264 True 0.013374 1.000000
15 -4.788847 True 0.097610 0.903352
16 -3.000000 False 0.000000 0.000000
17 -2.816756 True 0.041668 1.000000
18 -3.917621 True 0.071688 0.958091
19 -5.359315 True 0.112396 0.843265
20 -2.006944 True 0.020404 1.000000
21 -1.448435 True 0.006557 1.000000
22 -2.552348 True 0.034494 1.000000
23 -3.093718 True 0.049527 1.000000
24 -4.326266 True 0.083659 0.935486
25 -4.005316 False 1.000000 1.000000
26 -3.653069 True 0.065525 0.984877
27 -2.152013 True 0.024079 1.000000
28 -5.042775 True 0.103928 0.875541
29 -4.550371 True 0.089798 0.916979
30 -4.113974 True 0.077855 0.951802
31 -5.611616 True 0.121575 0.825490
32 -3.240207 True 0.053860 1.000000
33 -1.313363 True 0.003250 1.000000
34 -3.784292 True 0.068957 0.975346
35 -4.184972 False 0.732985 1.000000
36 -5.411661 False 0.672396 0.722577
37 -6.458636 False 0.696218 0.544637
38 -1.246621 True 0.001618 1.000000
39 -2.424952 True 0.031129 1.000000
40 -2.682689 True 0.037996 1.000000
41 -2.952639 True 0.045474 1.000000
42 -3.523227 True 0.062090 0.993367
43 -4.667131 True 0.093131 0.907679
44 -4.436637 True 0.086689 0.926583
45 -1.585609 True 0.009926 1.000000
46 -4.218945 True 0.080687 0.943602
47 -1.380619 True 0.004896 1.000000
48 -1.864723 True 0.016839 1.000000
49 -5.339792 False 1.000000 0.672474
##############################################
Get the Best Trial#
best_fitted_trials uses the data to do a fitting from all trials and with the noise levels you provided (or if no noise levels was provided, it assumed an unknown level of noise and inferred the noise level from the trial runs)
1trial = scheduler.best_fitted_trials()
2trial
[INFO 07-13 14:32:35] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
{5: {'params': {'x0': 0.058607747184593696, 'x1': 1.0},
'means': {'branin': -4.7050441454830025, 'currin': -3.3953789314264324},
'cov_matrix': {'branin': {'branin': 0.00013756326699888865, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.841244830810778e-06}}},
8: {'params': {'x0': 0.0, 'x1': 1.0},
'means': {'branin': -17.506033432938764, 'currin': -1.180053704082634},
'cov_matrix': {'branin': {'branin': 0.00013546227963810216, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.3068115437200997e-06}}},
11: {'params': {'x0': 0.02788589200513968, 'x1': 1.0},
'means': {'branin': -9.756586720344997, 'currin': -2.3002794474233026},
'cov_matrix': {'branin': {'branin': 6.72758481420603e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 9.92174240095971e-07}}},
14: {'params': {'x0': 0.01337350973969159, 'x1': 1.0},
'means': {'branin': -13.439514149380575, 'currin': -1.7253909772132952},
'cov_matrix': {'branin': {'branin': 6.644393339241738e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.0750998161793646e-06}}},
15: {'params': {'x0': 0.09760968515294619, 'x1': 0.9033515154200571},
'means': {'branin': -1.2307812622414644, 'currin': -4.789056968818793},
'cov_matrix': {'branin': {'branin': 0.0001570990134859989, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.9826752555455763e-06}}},
17: {'params': {'x0': 0.041668138136527644, 'x1': 1.0},
'means': {'branin': -7.011065763378252, 'currin': -2.816734841265921},
'cov_matrix': {'branin': {'branin': 7.10215758287429e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.0721517815328949e-06}}},
18: {'params': {'x0': 0.0716875955952911, 'x1': 0.9580908498468903},
'means': {'branin': -3.2128987191502567, 'currin': -3.917612765689042},
'cov_matrix': {'branin': {'branin': 0.00017032103519308775, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.092143825906518e-06}}},
19: {'params': {'x0': 0.11239570870390903, 'x1': 0.8432649704572479},
'means': {'branin': -0.5418969944135537, 'currin': -5.358417121853947},
'cov_matrix': {'branin': {'branin': 0.0002122772230446082, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 3.5195601392530723e-06}}},
20: {'params': {'x0': 0.02040369170653894, 'x1': 1.0},
'means': {'branin': -11.557018422257606, 'currin': -2.0069179257698777},
'cov_matrix': {'branin': {'branin': 6.91392626578105e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.0208171410969618e-06}}},
21: {'params': {'x0': 0.00655699293535461, 'x1': 1.0},
'means': {'branin': -15.436631509543615, 'currin': -1.4486230406119942},
'cov_matrix': {'branin': {'branin': 5.784272467789646e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 8.632145868488649e-07}}},
22: {'params': {'x0': 0.03449388657898811, 'x1': 1.0},
'means': {'branin': -8.345780049230978, 'currin': -2.552295505641358},
'cov_matrix': {'branin': {'branin': 6.639231145639397e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 9.913730739075708e-07}}},
23: {'params': {'x0': 0.04952662991879656, 'x1': 1.0},
'means': {'branin': -5.7917726129030385, 'currin': -3.0937386232068977},
'cov_matrix': {'branin': {'branin': 8.310349310267826e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.157487836301275e-06}}},
24: {'params': {'x0': 0.08365924892963733, 'x1': 0.9354860121514168},
'means': {'branin': -2.1620056623544794, 'currin': -4.326385078152994},
'cov_matrix': {'branin': {'branin': 8.251072791410869e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.1235483071904282e-06}}},
26: {'params': {'x0': 0.06552524539801446, 'x1': 0.9848772877560428},
'means': {'branin': -3.936994631064115, 'currin': -3.6529786821315335},
'cov_matrix': {'branin': {'branin': 9.81173962604765e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.296777715315678e-06}}},
27: {'params': {'x0': 0.024078761923997247, 'x1': 1.0},
'means': {'branin': -10.64618137352435, 'currin': -2.1519477775620186},
'cov_matrix': {'branin': {'branin': 6.924609218529233e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.0032982958499038e-06}}},
28: {'params': {'x0': 0.10392796257135913, 'x1': 0.8755408867421628},
'means': {'branin': -0.841333383469328, 'currin': -5.043005985587309},
'cov_matrix': {'branin': {'branin': 0.0001987881942199507, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 2.6999807691987326e-06}}},
29: {'params': {'x0': 0.08979817795234582, 'x1': 0.9169786644590722},
'means': {'branin': -1.6730611322134585, 'currin': -4.550505620620173},
'cov_matrix': {'branin': {'branin': 8.767803388677445e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.1746936215781019e-06}}},
30: {'params': {'x0': 0.07785524764767986, 'x1': 0.9518020585777327},
'means': {'branin': -2.6764156696664685, 'currin': -4.114043037110592},
'cov_matrix': {'branin': {'branin': 0.0001127811411823995, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.2602880640377312e-06}}},
31: {'params': {'x0': 0.12157501887429062, 'x1': 0.8254903306037356},
'means': {'branin': -0.40450481178859654, 'currin': -5.6122479041448115},
'cov_matrix': {'branin': {'branin': 0.00022050754320547062, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 4.675683400939879e-06}}},
32: {'params': {'x0': 0.05386019078164375, 'x1': 1.0},
'means': {'branin': -5.229847326706208, 'currin': -3.240268408259183},
'cov_matrix': {'branin': {'branin': 8.557783863903338e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.2083514487584911e-06}}},
33: {'params': {'x0': 0.003249984243833066, 'x1': 1.0},
'means': {'branin': -16.463430345532228, 'currin': -1.3133972884528422},
'cov_matrix': {'branin': {'branin': 4.741494675985097e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 9.294097699209482e-07}}},
34: {'params': {'x0': 0.06895655019208942, 'x1': 0.9753464069050974},
'means': {'branin': -3.5602540426668714, 'currin': -3.7842142621059853},
'cov_matrix': {'branin': {'branin': 0.00011429045547454886, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.3915586527965429e-06}}},
38: {'params': {'x0': 0.0016182043024408892, 'x1': 1.0},
'means': {'branin': -16.982965091033794, 'currin': -1.246496325131448},
'cov_matrix': {'branin': {'branin': 6.228971569601035e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.3430405568892165e-06}}},
39: {'params': {'x0': 0.031128832173220582, 'x1': 1.0},
'means': {'branin': -9.042847271459031, 'currin': -2.424885035481854},
'cov_matrix': {'branin': {'branin': 6.576869397855032e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 9.8601816248227e-07}}},
40: {'params': {'x0': 0.03799558206052214, 'x1': 1.0},
'means': {'branin': -7.668285032666206, 'currin': -2.682652548162963},
'cov_matrix': {'branin': {'branin': 6.855871889604158e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.0191034920158612e-06}}},
41: {'params': {'x0': 0.04547388676332354, 'x1': 1.0},
'means': {'branin': -6.38850016752999, 'currin': -2.952634871407888},
'cov_matrix': {'branin': {'branin': 7.503137519011389e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.1304003470288392e-06}}},
42: {'params': {'x0': 0.06208990677590783, 'x1': 0.9933672100609731},
'means': {'branin': -4.319704947241787, 'currin': -3.5232071384331527},
'cov_matrix': {'branin': {'branin': 8.911721514602213e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.3259274716204907e-06}}},
43: {'params': {'x0': 0.09313073356253875, 'x1': 0.9076785619927272},
'means': {'branin': -1.4420645734829165, 'currin': -4.667272447440661},
'cov_matrix': {'branin': {'branin': 0.00010978971045565751, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.3424911634845635e-06}}},
44: {'params': {'x0': 0.08668927352903318, 'x1': 0.9265827657816511},
'means': {'branin': -1.9137632282044557, 'currin': -4.436766041178403},
'cov_matrix': {'branin': {'branin': 8.75945849355438e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.1178466084404268e-06}}},
45: {'params': {'x0': 0.009926278687075732, 'x1': 1.0},
'means': {'branin': -14.428783869666335, 'currin': -1.5858027377169162},
'cov_matrix': {'branin': {'branin': 6.431882097188617e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.0178881979226616e-06}}},
46: {'params': {'x0': 0.08068734182726725, 'x1': 0.9436020083517326},
'means': {'branin': -2.416231478487198, 'currin': -4.219047009609061},
'cov_matrix': {'branin': {'branin': 8.239765555556916e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.1724794444960076e-06}}},
47: {'params': {'x0': 0.0048956387240143215, 'x1': 1.0},
'means': {'branin': -15.947968638784397, 'currin': -1.380753574921319},
'cov_matrix': {'branin': {'branin': 5.1457470192595185e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 8.242771961026105e-07}}},
48: {'params': {'x0': 0.016839055909188713, 'x1': 1.0},
'means': {'branin': -12.48870494437146, 'currin': -1.8647659290992573},
'cov_matrix': {'branin': {'branin': 6.794896695388704e-05, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 1.0527363249805335e-06}}}}
if you need the exact points of the best trial, maybe because you need the trial number of the best trial to plot results, or for any other reason, best_raw_trails does not do any fitting
1trial = scheduler.best_raw_trials()
2trial
[INFO 07-13 14:32:35] ax.modelbridge.torch: The observations are identical to the last set of observations used to fit the model. Skipping model fitting.
{5: {'params': {'x0': 0.058607747184593696, 'x1': 1.0},
'means': {'branin': -4.707081317901611, 'currin': -3.395252227783203},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
8: {'params': {'x0': 0.0, 'x1': 1.0},
'means': {'branin': -17.508296966552734, 'currin': -1.180408000946045},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
11: {'params': {'x0': 0.02788589200513968, 'x1': 1.0},
'means': {'branin': -9.756551742553711, 'currin': -2.300353765487671},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
14: {'params': {'x0': 0.01337350973969159, 'x1': 1.0},
'means': {'branin': -13.43986701965332, 'currin': -1.7252644300460815},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
15: {'params': {'x0': 0.09760968515294619, 'x1': 0.9033515154200571},
'means': {'branin': -1.2292280197143555, 'currin': -4.788846969604492},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
17: {'params': {'x0': 0.041668138136527644, 'x1': 1.0},
'means': {'branin': -7.011050701141357, 'currin': -2.816755771636963},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
18: {'params': {'x0': 0.0716875955952911, 'x1': 0.9580908498468903},
'means': {'branin': -3.212923526763916, 'currin': -3.917620897293091},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
19: {'params': {'x0': 0.11239570870390903, 'x1': 0.8432649704572479},
'means': {'branin': -0.5423154830932617, 'currin': -5.359314918518066},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
20: {'params': {'x0': 0.02040369170653894, 'x1': 1.0},
'means': {'branin': -11.557344436645508, 'currin': -2.006943702697754},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
21: {'params': {'x0': 0.00655699293535461, 'x1': 1.0},
'means': {'branin': -15.435508728027344, 'currin': -1.4484350681304932},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
22: {'params': {'x0': 0.03449388657898811, 'x1': 1.0},
'means': {'branin': -8.345803260803223, 'currin': -2.5523483753204346},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
23: {'params': {'x0': 0.04952662991879656, 'x1': 1.0},
'means': {'branin': -5.791337966918945, 'currin': -3.093717575073242},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
24: {'params': {'x0': 0.08365924892963733, 'x1': 0.9354860121514168},
'means': {'branin': -2.1616764068603516, 'currin': -4.326265811920166},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
26: {'params': {'x0': 0.06552524539801446, 'x1': 0.9848772877560428},
'means': {'branin': -3.936014175415039, 'currin': -3.653069019317627},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
27: {'params': {'x0': 0.024078761923997247, 'x1': 1.0},
'means': {'branin': -10.64627456665039, 'currin': -2.152012586593628},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
28: {'params': {'x0': 0.10392796257135913, 'x1': 0.8755408867421628},
'means': {'branin': -0.8413734436035156, 'currin': -5.042774677276611},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
29: {'params': {'x0': 0.08979817795234582, 'x1': 0.9169786644590722},
'means': {'branin': -1.6735401153564453, 'currin': -4.550370693206787},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
30: {'params': {'x0': 0.07785524764767986, 'x1': 0.9518020585777327},
'means': {'branin': -2.6767940521240234, 'currin': -4.113973617553711},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
31: {'params': {'x0': 0.12157501887429062, 'x1': 0.8254903306037356},
'means': {'branin': -0.4042530059814453, 'currin': -5.611616134643555},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
32: {'params': {'x0': 0.05386019078164375, 'x1': 1.0},
'means': {'branin': -5.229813098907471, 'currin': -3.240206718444824},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
33: {'params': {'x0': 0.003249984243833066, 'x1': 1.0},
'means': {'branin': -16.462448120117188, 'currin': -1.313362956047058},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
34: {'params': {'x0': 0.06895655019208942, 'x1': 0.9753464069050974},
'means': {'branin': -3.5601887702941895, 'currin': -3.784292221069336},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
38: {'params': {'x0': 0.0016182043024408892, 'x1': 1.0},
'means': {'branin': -16.983062744140625, 'currin': -1.2466212511062622},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
39: {'params': {'x0': 0.031128832173220582, 'x1': 1.0},
'means': {'branin': -9.042816162109375, 'currin': -2.424952268600464},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
40: {'params': {'x0': 0.03799558206052214, 'x1': 1.0},
'means': {'branin': -7.668343544006348, 'currin': -2.6826891899108887},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
41: {'params': {'x0': 0.04547388676332354, 'x1': 1.0},
'means': {'branin': -6.388263702392578, 'currin': -2.952639102935791},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
42: {'params': {'x0': 0.06208990677590783, 'x1': 0.9933672100609731},
'means': {'branin': -4.3190178871154785, 'currin': -3.5232274532318115},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
43: {'params': {'x0': 0.09313073356253875, 'x1': 0.9076785619927272},
'means': {'branin': -1.4436731338500977, 'currin': -4.667131423950195},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
44: {'params': {'x0': 0.08668927352903318, 'x1': 0.9265827657816511},
'means': {'branin': -1.9134502410888672, 'currin': -4.4366374015808105},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
45: {'params': {'x0': 0.009926278687075732, 'x1': 1.0},
'means': {'branin': -14.428484916687012, 'currin': -1.5856086015701294},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
46: {'params': {'x0': 0.08068734182726725, 'x1': 0.9436020083517326},
'means': {'branin': -2.416285514831543, 'currin': -4.218944549560547},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
47: {'params': {'x0': 0.0048956387240143215, 'x1': 1.0},
'means': {'branin': -15.946688652038574, 'currin': -1.3806185722351074},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}},
48: {'params': {'x0': 0.016839055909188713, 'x1': 1.0},
'means': {'branin': -12.489206314086914, 'currin': -1.8647232055664062},
'cov_matrix': {'branin': {'branin': 0.0, 'currin': 0.0},
'currin': {'branin': 0.0, 'currin': 0.0}}}}
Output All Trials#
1boa.scheduler_to_df(scheduler)
| trial_index | arm_name | trial_status | generation_method | branin | currin | is_feasible | x0 | x1 | |
|---|---|---|---|---|---|---|---|---|---|
| 0 | 0 | 0_0 | COMPLETED | Sobol | -109.987946 | -4.971244 | False | 0.856628 | 0.764265 |
| 1 | 1 | 1_0 | COMPLETED | Sobol | -2.655920 | -7.005593 | False | 0.157682 | 0.671000 |
| 2 | 2 | 2_0 | COMPLETED | Sobol | -35.314487 | -12.795367 | False | 0.357816 | 0.092607 |
| 3 | 3 | 3_0 | COMPLETED | Sobol | -51.288143 | -2.498643 | False | 0.016990 | 0.670656 |
| 4 | 4 | 4_0 | COMPLETED | Sobol | -0.992895 | -10.797516 | False | 0.562803 | 0.163890 |
| 5 | 5 | 5_0 | COMPLETED | MOO | -4.707081 | -3.395252 | True | 0.058608 | 1.000000 |
| 6 | 6 | 6_0 | COMPLETED | MOO | -10.960894 | -10.179487 | False | 1.000000 | 0.000000 |
| 7 | 7 | 7_0 | COMPLETED | MOO | -55.937115 | -5.405636 | False | 0.243453 | 1.000000 |
| 8 | 8 | 8_0 | COMPLETED | MOO | -17.508297 | -1.180408 | True | 0.000000 | 1.000000 |
| 9 | 9 | 9_0 | COMPLETED | MOO | -26.455505 | -1.280036 | False | 0.000000 | 0.898782 |
| 10 | 10 | 10_0 | COMPLETED | MOO | -2.751491 | -4.412967 | True | 0.080315 | 0.885963 |
| 11 | 11 | 11_0 | COMPLETED | MOO | -9.756552 | -2.300354 | True | 0.027886 | 1.000000 |
| 12 | 12 | 12_0 | COMPLETED | MOO | -167.167480 | -4.468507 | False | 0.558653 | 1.000000 |
| 13 | 13 | 13_0 | COMPLETED | MOO | -2.697469 | -4.486275 | True | 0.095033 | 0.968575 |
| 14 | 14 | 14_0 | COMPLETED | MOO | -13.439867 | -1.725264 | True | 0.013374 | 1.000000 |
| 15 | 15 | 15_0 | COMPLETED | MOO | -1.229228 | -4.788847 | True | 0.097610 | 0.903352 |
| 16 | 16 | 16_0 | COMPLETED | MOO | -308.129059 | -3.000000 | False | 0.000000 | 0.000000 |
| 17 | 17 | 17_0 | COMPLETED | MOO | -7.011051 | -2.816756 | True | 0.041668 | 1.000000 |
| 18 | 18 | 18_0 | COMPLETED | MOO | -3.212924 | -3.917621 | True | 0.071688 | 0.958091 |
| 19 | 19 | 19_0 | COMPLETED | MOO | -0.542315 | -5.359315 | True | 0.112396 | 0.843265 |
| 20 | 20 | 20_0 | COMPLETED | MOO | -11.557344 | -2.006944 | True | 0.020404 | 1.000000 |
| 21 | 21 | 21_0 | COMPLETED | MOO | -15.435509 | -1.448435 | True | 0.006557 | 1.000000 |
| 22 | 22 | 22_0 | COMPLETED | MOO | -8.345803 | -2.552348 | True | 0.034494 | 1.000000 |
| 23 | 23 | 23_0 | COMPLETED | MOO | -5.791338 | -3.093718 | True | 0.049527 | 1.000000 |
| 24 | 24 | 24_0 | COMPLETED | MOO | -2.161676 | -4.326266 | True | 0.083659 | 0.935486 |
| 25 | 25 | 25_0 | COMPLETED | MOO | -145.872208 | -4.005316 | False | 1.000000 | 1.000000 |
| 26 | 26 | 26_0 | COMPLETED | MOO | -3.936014 | -3.653069 | True | 0.065525 | 0.984877 |
| 27 | 27 | 27_0 | COMPLETED | MOO | -10.646275 | -2.152013 | True | 0.024079 | 1.000000 |
| 28 | 28 | 28_0 | COMPLETED | MOO | -0.841373 | -5.042775 | True | 0.103928 | 0.875541 |
| 29 | 29 | 29_0 | COMPLETED | MOO | -1.673540 | -4.550371 | True | 0.089798 | 0.916979 |
| 30 | 30 | 30_0 | COMPLETED | MOO | -2.676794 | -4.113974 | True | 0.077855 | 0.951802 |
| 31 | 31 | 31_0 | COMPLETED | MOO | -0.404253 | -5.611616 | True | 0.121575 | 0.825490 |
| 32 | 32 | 32_0 | COMPLETED | MOO | -5.229813 | -3.240207 | True | 0.053860 | 1.000000 |
| 33 | 33 | 33_0 | COMPLETED | MOO | -16.462448 | -1.313363 | True | 0.003250 | 1.000000 |
| 34 | 34 | 34_0 | COMPLETED | MOO | -3.560189 | -3.784292 | True | 0.068957 | 0.975346 |
| 35 | 35 | 35_0 | COMPLETED | MOO | -212.371979 | -4.184972 | False | 0.732985 | 1.000000 |
| 36 | 36 | 36_0 | COMPLETED | MOO | -105.502625 | -5.411661 | False | 0.672396 | 0.722577 |
| 37 | 37 | 37_0 | COMPLETED | MOO | -65.481857 | -6.458636 | False | 0.696218 | 0.544637 |
| 38 | 38 | 38_0 | COMPLETED | MOO | -16.983063 | -1.246621 | True | 0.001618 | 1.000000 |
| 39 | 39 | 39_0 | COMPLETED | MOO | -9.042816 | -2.424952 | True | 0.031129 | 1.000000 |
| 40 | 40 | 40_0 | COMPLETED | MOO | -7.668344 | -2.682689 | True | 0.037996 | 1.000000 |
| 41 | 41 | 41_0 | COMPLETED | MOO | -6.388264 | -2.952639 | True | 0.045474 | 1.000000 |
| 42 | 42 | 42_0 | COMPLETED | MOO | -4.319018 | -3.523227 | True | 0.062090 | 0.993367 |
| 43 | 43 | 43_0 | COMPLETED | MOO | -1.443673 | -4.667131 | True | 0.093131 | 0.907679 |
| 44 | 44 | 44_0 | COMPLETED | MOO | -1.913450 | -4.436637 | True | 0.086689 | 0.926583 |
| 45 | 45 | 45_0 | COMPLETED | MOO | -14.428485 | -1.585609 | True | 0.009926 | 1.000000 |
| 46 | 46 | 46_0 | COMPLETED | MOO | -2.416286 | -4.218945 | True | 0.080687 | 0.943602 |
| 47 | 47 | 47_0 | COMPLETED | MOO | -15.946689 | -1.380619 | True | 0.004896 | 1.000000 |
| 48 | 48 | 48_0 | COMPLETED | MOO | -12.489206 | -1.864723 | True | 0.016839 | 1.000000 |
| 49 | 49 | 49_0 | COMPLETED | MOO | -52.128422 | -5.339792 | False | 1.000000 | 0.672474 |