Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to start letta server in local setup #2328

Open
5 tasks
AjitAntony opened this issue Jan 4, 2025 · 0 comments
Open
5 tasks

Unable to start letta server in local setup #2328

AjitAntony opened this issue Jan 4, 2025 · 0 comments

Comments

@AjitAntony
Copy link

AjitAntony commented Jan 4, 2025

Describe the bug
Unable to start letta server in local setup . kindly assist on how to setup letta in local workstation . I followed the steps in https://www.youtube.com/watch?v=EOkpFDBNyEw as well but still got into below issue .

Please describe your setup

  • How did you install letta?
    • pip install letta
  • Describe your setup
    • What's your OS (Windows/MacOS/Linux)? Windows
    • How are you running letta? (cmd.exe/Powershell/Anaconda Shell/Terminal) cmd.exe

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
python version
Python 3.10.6

(.venv) C:\Users\user\Documents\tutorial\agents\memgpt>letta version
0.1.14
encountered same issue in 0.1.16 version as well while trying to follow the setup posted in this video https://www.youtube.com/watch?v=EOkpFDBNyEw
(.venv) C:\Users\user\Documents\tutorial\agents\memgpt>letta quickstart
(.venv) C:\Users\user\Documents\tutorial\agents\memgpt>letta configure
(.venv) C:\Users\user\Documents\tutorial\agents\memgpt>letta run

all above 3 commands return below error
Traceback (most recent call last):
File "C:\Users\user\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Users\user\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in run_code
exec(code, run_globals)
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\Scripts\letta.exe_main
.py", line 7, in
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\typer\main.py", line 328, in call
raise e
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\typer\main.py", line 311, in call
return get_command(self)(*args, **kwargs)
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\click\core.py", line 1161, in call
return self.main(*args, **kwargs)
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\typer\core.py", line 783, in main
return _main(
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\typer\core.py", line 225, in _main
rv = self.invoke(ctx)
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\click\core.py", line 1697, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\click\core.py", line 1443, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\click\core.py", line 788, in invoke
return __callback(*args, **kwargs)
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\typer\main.py", line 683, in wrapper
return callback(**use_params) # type: ignore
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\letta\cli\cli.py", line 178, in quickstart
new_config, config_was_modified = set_config_with_dict(backup_config)
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\letta\cli\cli.py", line 63, in set_config_with_dict
old_config = LettaConfig.load()
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\letta\config.py", line 165, in load
llm_config = LLMConfig(**llm_config_dict)
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\pydantic\main.py", line 212, in init
validated_self = self.pydantic_validator.validate_python(data, self_instance=self)
pydantic_core._pydantic_core.ValidationError: 4 validation errors for LLMConfig
model
Field required [type=missing, input_value={}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.9/v/missing
model_endpoint_type
Field required [type=missing, input_value={}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.9/v/missing
model_endpoint
Field required [type=missing, input_value={}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.9/v/missing
context_window
Field required [type=missing, input_value={}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.9/v/missing

Letta Config
Please attach your ~/.letta/config file or copy paste it below.

There is no documentation steps on how to to setup letta/config
letta quickstart
letta run
letta configure
all return the same error .


If you're not using OpenAI, please provide additional information on your local LLM setup:
I am using Azure OpenAI and have setup the environmental variables
AZURE_API_KEY="..."
AZURE_BASE_URL="..."
AZURE_API_VERSION="..."

Local LLM details

If you are trying to run Letta with local LLMs, please provide the following information:

  • The exact model you're trying to use (e.g. dolphin-2.1-mistral-7b.Q6_K.gguf)
  • The local LLM backend you are using (web UI? LM Studio?)
  • Your hardware for the local LLM backend (local computer? operating system? remote RunPod?)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant