Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to test Model you had train ? #8

Open
ndamtruong2k opened this issue Dec 20, 2021 · 1 comment
Open

How to test Model you had train ? #8

ndamtruong2k opened this issue Dec 20, 2021 · 1 comment

Comments

@ndamtruong2k
Copy link

ndamtruong2k commented Dec 20, 2021

Hello author
I want to test model of you but i don't know do that
Please help me

@Luca96
Copy link
Owner

Luca96 commented Dec 31, 2021

Hi (and sorry for the delay),

Basically the evaluation phase runs the agent on the last (and most complete) stage, on the town you specify, while collecting useful statistics to compute metrics for comparison (as detailed in the paper).

You can refer to the code: core/learning/evaluate and here, which is the full evaluation.

There is also a Jupyter notebook that computes the metrics from the agent runs. It's a bit messy but you should be able to use it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants