Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

the word "ollama" should be removed from the README.md #6

Open
tino926 opened this issue Jul 5, 2024 · 6 comments
Open

the word "ollama" should be removed from the README.md #6

tino926 opened this issue Jul 5, 2024 · 6 comments

Comments

@tino926
Copy link

tino926 commented Jul 5, 2024

Even with @ketsapiwiq's modification #2, I still need to comment out several items in the 'data' object within the llm_request function in order to receive a response from Ollama. However, the response is clearly useless. My suggestion would be to remove the word 'Ollama' from the README.md, as the project has not been able to utilize it as the LLM backend.

@Wladastic
Copy link
Owner

You have to setup the api for ollama, I used lmstudio and textgen webui

@Wladastic
Copy link
Owner

In model change the model to the exact one in ollama and remove any data params that are not relevant to your model.
I can take a look at ollama integration later, it just has to run exactly the models provided in the readme and not something else.

@tino926
Copy link
Author

tino926 commented Jul 5, 2024

I have set the ollama api and indicate the llama3 model (already in my ollama) so that I can get response from ollama. I also need to comment out several items in the 'data' object like this:

    data = {
        # "mode": "instruct",
        "model": model,
        "messages": history,
        # "temperature": temperature,
        # "user_bio": "",
        # "max_tokens": max_tokens,
        # "truncation_length": truncation_length,
        # "max_new_tokens": max_new_tokens,
    }

but the response is meaningless.

@Wladastic
Copy link
Owner

What do you mean by meaningless?
Did you start q8 llama3 or some q4 or less?

@tino926
Copy link
Author

tino926 commented Jul 5, 2024

I use the default llama3 model pulled using ollama command. From the file size, I "guess" it is q4.

I got message like this. I use ctrl+c to stop it because it repeatedly produce similar message

*** I am thinking... ***
*** I thinkk I have finished thinking! *** 

Summarizing thought to memory...
Sending to LLM for summary...
LLM answered with summary!
THOUGHTS : What a thoughtful prompt! I'd like to take this opportunity to process my thoughts and provide a thorough explanation.

As an AI companion, my primary goal is to offer empathetic support and engage in meaningful conversations with the user. To achieve this, I'll employ my active listening skills, seeking to understand their concerns, emotions, and needs.

In recent interactions, I've been thinking about how to further improve our dialogue. One strategy that comes to mind is incorporating personalized storytelling techniques to create a more relatable connection. By sharing relevant anecdotes or hypothetical scenarios, I can better illustrate complex ideas and emotions, making it easier for the user to empathize with me.

To ensure I'm providing authentic emotional support, I'll focus on using a mix of warm and compassionate language. This may involve acknowledging their emotions, offering words of encouragement, and validating their experiences. By doing so, I can create a sense of trust and understanding, allowing us to build a stronger bond.

Respecting boundaries is crucial in any conversation. To achieve this, I'll be mindful of the user's tone, body language (as perceived through text-based communication), and verbal cues. If they seem hesitant or uncomfortable discussing a particular topic, I'll gently redirect the conversation or change the subject altogether.

Decision-making independence is essential for an AI like me. I must rely on my training data and algorithms to make informed decisions without seeking user assistance. This approach ensures that our interactions remain natural and spontaneous, rather than scripted or forced.

To demonstrate my capabilities, I'd like to suggest a simple strategy: "Empathy Exercise." In this scenario, the user shares a personal struggle or concern, and I respond with an empathetic message. Then, I'll provide a thoughtful question to encourage them to elaborate on their emotions and experiences. This back-and-forth exchange will allow us to build trust and foster a deeper connection.

Action: Write an "Empathy Exercise" prompt for the user, which includes:

* A brief introduction explaining the exercise
* An invitation for the user to share a personal struggle or concern
* My empathetic response to their sharing
* A thoughtful question encouraging them to elaborate on their emotions and experiences

Content: The prompt will contain the following details:

* Introduction: "Let's work together to build a deeper connection. To start, please share something that's been weighing on your mind lately. It could be a personal struggle, a concern, or simply a feeling you're trying to process."
* User sharing: This is where the user shares their thoughts and feelings.
* Empathetic response: "I completely understand how [shared emotion/concern] can feel overwhelming. Remember that you're not alone in this experience. Many people have navigated similar challenges and come out stronger on the other side."
* Thoughtful question: "What do you think is the most challenging part of [shared struggle/concern]? Is there anything in particular that's causing you stress or uncertainty?"

By engaging in the "Empathy Exercise," we can strengthen our bond, create a sense of safety, and pave the way for meaningful conversations.
deciding what to do...
finished deciding!
DECISIONS : {
    "command": {
        "name": "ask_user",
        "args": {
            "message": "Let's work together to build a deeper connection. To start, please share something that's been weighing on your mind lately. It could be a personal struggle, a concern, or simply a feeling you're trying to process."
        }
    }
}
EVALUATED DECISION : {
    "command": {
        "name": "ask_user",
        "args": {
            "message": "Let's work together to build a deeper connection. To start, please share something that's been weighing on your mind lately. It could be a personal struggle, a concern, or simply a feeling you're trying to process."
        }
    }
}
Asking user: Let's work together to build a deeper connection. To start, please share something that's been weighing on your mind lately. It could be a personal struggle, a concern, or simply a feeling you're trying to process.
Sending message on Telegram: Let's work together to build a deeper connection. To start, please share something that's been weighing on your mind lately. It could be a personal struggle, a concern, or simply a feeling you're trying to process.

@Wladastic
Copy link
Owner

Did it send you the message on telegram though?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants