I am using Ray Tune's TuneSearchCV
to perform a model hyperparameter search.
I would like to register a callback (in this case to simply print some extra metrics).
I have no problem writing the callback (see https://docs.ray.io/en/latest/tune/tutorials/tune-metrics.html for details), and to register it via
tuner = tune.Tuner(
train,
run_config=air.RunConfig(callbacks=[MyCallback()]))
tuner.fit()
But how can I register the callback with TuneSearchCV
rather (or will the above do the job)?
Thanks!
Update: Crickets :( I'd also like to pass a Reporter (https://docs.ray.io/en/releases-1.11.0/tune/api_docs/reporters.html) via the Ray Tune sklearn API. Is that possible?