New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Current Project Timeline #46

Open

goyalpramod opened this issue Jul 2, 2023 · 0 comments

Contributor

goyalpramod commented Jul 2, 2023 •

edited

Loading

Implementation of a testing environment (1 week)

The Spider dataset as well as the WikiSQL dataset have a testing framework. That can be used to evaluate our predictions.
Link to evaluation framework of Spider dataset.
The Spider and WikiSQL use SQLite DB and our solution uses MySQL. The DB needs to be converted to MySQL before it can be tested. SQLite to MySQL
The predictions need to be made sequentially, and stored in a JSON format.

Improving the current model (1 week)

Link to the issue regarding the above topic.
Currently ways to improve the results by producing good extra hard prompts are being worked upon.

Evaluate Implementation of RAT (1-2 weeks)

Link to repository

Optimization of tokens (1-2 weeks)

The current model uses OpenAI API to generate responses and we would be most likely move forward with that methodology
New methods need to be explored, Link

goyalpramod changed the title ~~Project timeline for the project~~ Current Project Timeline

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment