Feature: Implement option to use LLaMA instead of GPT

[devAyushDubey]

Description

IkarisGPT currently uses OpenAI APIs to get Issue descriptions. With the increasing API prices and restrictions coming in, it makes case for us to provide an option to use other LLM APIs (LLaMA for this particular issue).

Tasks

• Re-structure the project to support such a feature.
• Implement a design for the user to enter API Keys using Github Secrets.
• Research and write a strong prompt for generating Issue description based on your provided context.
• Write good quality code for making fast API call.
• Use GitHub Action Bot for commenting out the outcome on the issue.

Expected Outcome

User should be able to specify which LLM service they want to use (GPT or LLaMA).

[Bayyana-kiran]

hey @devAyushDubey can u assign me this issue i can work on this?

[praptisharma28]

@devAyushDubey , I can build and run a Medical Chatbot using Llama 2 on CPU Machine coz I learned doing it earlier. I can make a differebt folder for it too. If you are okay with my idea, you can assign me.

[Bayyana-kiran]

HEY @devAyushDubey so my idea is to build a option or feature which is able to access both the gpt api and also llama....i can have worked on api's and the feature should be user friendly. And @praptisharma28 it is FCFS(First come first serve) principle i think so.

[devAyushDubey]

Hey @praptisharma28 and @Bayyana-kiran, I appreciate your interest in taking up this issue. This issue as also labelled is a little complex and requires a lot of thinking before writing any code.
I would appreciate if you could provide me with a rough idea of how you are going to do it.