Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Combining learning approaches #63

Open
jemrobinson opened this issue Jun 19, 2023 · 0 comments
Open

Combining learning approaches #63

jemrobinson opened this issue Jun 19, 2023 · 0 comments
Labels
idea Idea to investigate

Comments

@jemrobinson
Copy link
Member

We used two models, one trained on files with traceability back to the original source (llama) and one trained on Q&A generated from files (curie). One way to combine these two might be:

  • collect all relevant files
  • run a preprocessing step that creates Q&A for each file.
  • create a new file containing the original data + the Q&A
  • train the llama model on this

This could give us the "here's where I pulled the answer from" structure of llama plus the nice answers coming from the curie model. Thoughts?

@jemrobinson jemrobinson changed the title Combining approaches Combining learning approaches Jun 19, 2023
@rchan26 rchan26 added enhancement New feature or request idea Idea to investigate and removed enhancement New feature or request labels Sep 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
idea Idea to investigate
Projects
None yet
Development

No branches or pull requests

2 participants