Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SELA #1514

Merged
merged 196 commits into from
Oct 31, 2024
Merged

SELA #1514

merged 196 commits into from
Oct 31, 2024

Conversation

garylin2099
Copy link
Collaborator

No description provided.

cyzus and others added 30 commits August 30, 2024 16:26
2. fix bug
2. 修改prompt,让predictions.csv生成的格式与原gt格式一样
add experimenter

See merge request agents/exp_optimizer!1
2. fix duration
Experimenter

See merge request agents/exp_optimizer!2
fix import

See merge request agents/exp_optimizer!3
@garylin2099 garylin2099 removed their assignment Oct 28, 2024
.gitignore Outdated Show resolved Hide resolved
@garylin2099
Copy link
Collaborator Author

LGTM

Official implementation for paper [SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learning](https://arxiv.org/abs/2410.17238).


SELA is an innovative system that enhances Automated Machine Learning (AutoML) by integrating Monte Carlo Tree Search (MCTS) with LLM-based agents. Traditional AutoML methods often generate low-diversity and suboptimal code, limiting their effectiveness in model selection and ensembling. SELA addresses these challenges by representing pipeline configurations as trees, enabling agents to intelligently explore the solution space and iteratively refine their strategies based on experimental feedback.
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

solution space -> search space?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

solution space in paper abstract, i think it's okay if we are talking at a high level that the agent is searching for a solution or pipeline

python run_experiment.py --exp_mode rs --task titanic --rs_mode set
```

## 4. Citation
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also added to the outermost README of MetaGPT

datasets_dir = config["datasets_dir"]
if dataset_name in config["datasets"]:
dataset = config["datasets"][dataset_name]
data_path = os.path.join(datasets_dir, dataset["dataset"])
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I noticed that a lot of os.path is used. Can you use pathlib instead?

additional_instruction=additional_instruction,
data_info_path=data_info_path,
)
print(user_requirement)
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can all prints be changed to use metagpt logger?

Copy link
Owner

@geekan geekan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not perfect yet, but I'm going to put it in first.

@geekan geekan merged commit 21d9c5a into main Oct 31, 2024
2 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants