Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: automl.best_run_id is None after fitting when using max_iter #1403

Open
tsoernes opened this issue Feb 6, 2025 · 1 comment
Open
Labels
bug Something isn't working

Comments

@tsoernes
Copy link

tsoernes commented Feb 6, 2025

Describe the bug

I have this setup:

settings = {
    "max_iter": 1,
    #"time_budget": time_budget, # Total running time in seconds
    "estimator_list": ['prophet'],  # estimator_list for spark35 forecasting 
    "starting_points": {'prophet': starting_params},  # Starting hyperparameters
        "fit_kwargs_by_estimator": {
        "prophet": {
            "holidays": holidays_df,  # Pass as fixed parameter
            "weekly_seasonality":True,
            "daily_seasonality":True,
            "yearly_seasonality":True
        }
    },
    "task": "ts_forecast",  # Task type 
    "log_file_name": "flaml_experiment.log",  # FLAML log file
    "seed": 41 , # Random seed 
    "mlflow_exp_name": "Notebook1-AutoMLExperiment",  # MLflow experiment name
    "use_spark": True,  # whether to use Spark for distributed training
    "n_concurrent_trials": 3,  # the maximum number of concurrent trials 
    "verbose": 1, 
    "featurization": "off", 
    "metric": "rmse",  # Root Mean Squared Error
    "mlflow_logging": False,
}

# Create an AutoML instance
automl_24h = AutoML(**settings)
with mlflow.start_run(nested=True, run_name="AutoMLModel-Prophet") as run:
    automl_24h.fit(
        X_train=X,
        y_train=y_train_24h,  # target column of the training data
        period=24, # (a period is 1 hour)
        X_val=X,
        y_val=y_train_24h,
        split_ratio=0,
        force_cancel=False,
    )

However, after 1 successful run, automl_24h.best_run_id is None. This does not happen when using a time budged

Steps to reproduce

No response

Model Used

No response

Expected Behavior

No response

Screenshots and logs

No response

Additional Information

No response

@tsoernes tsoernes added the bug Something isn't working label Feb 6, 2025
@thinkall
Copy link
Collaborator

Hi @tsoernes , thank you for reporting this. Can you share the output logs? Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants