How to have OpenDevin up and running? #3316

silversonicaxel · 2024-08-09T14:13:41Z

silversonicaxel
Aug 9, 2024

Hello everyone
I'm using this documentation https://docs.all-hands.dev/modules/usage/llms/localLLMs to try to run OpenDevin and Ollama.
Following the tutorial, I got block after I run the application.

When I tried just to run only OpenDevin, I got similar issues.

Anyway, this is my console log and I believe some misconfiguration is occurring.
Any tips?
Do I need to share more information?

CodeActAgent LEVEL 0 LOCAL STEP 0 GLOBAL STEP 0


Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.

Traceback (most recent call last):
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/llms/openai.py", line 1032, in completion
    raise e
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/llms/openai.py", line 950, in completion
    self.make_sync_openai_chat_completion_request(
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/llms/openai.py", line 815, in make_sync_openai_chat_completion_request
    raise e
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/llms/openai.py", line 810, in make_sync_openai_chat_completion_request
    response = openai_client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/openai/_utils/_utils.py", line 277, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/openai/resources/chat/completions.py", line 646, in create
    return self._post(
           ^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/openai/_base_client.py", line 1266, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/openai/_base_client.py", line 942, in request
    return self._request(
           ^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/openai/_base_client.py", line 1046, in _request
    raise self._make_status_error_from_response(err.response) from None
openai.NotFoundError: Error code: 404 - {'error': {'message': 'The model `gpt-4` does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/main.py", line 1366, in completion
    raise e
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/main.py", line 1339, in completion
    response = openai_chat_completions.completion(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/llms/openai.py", line 1038, in completion
    raise OpenAIError(status_code=e.status_code, message=str(e))
litellm.llms.openai.OpenAIError: Error code: 404 - {'error': {'message': 'The model `gpt-4` does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/MY_USER/Dev/OpenDevin/opendevin/controller/agent_controller.py", line 143, in _start_step_loop
    await self._step()
  File "/Users/MY_USER/Dev/OpenDevin/opendevin/controller/agent_controller.py", line 400, in _step
    action = self.agent.step(self.state)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Dev/OpenDevin/agenthub/codeact_agent/codeact_agent.py", line 197, in step
    response = self.llm.completion(
               ^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/tenacity/__init__.py", line 336, in wrapped_f
    return copy(f, *args, **kw)
           ^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/tenacity/__init__.py", line 475, in __call__
    do = self.iter(retry_state=retry_state)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/tenacity/__init__.py", line 376, in iter
    result = action(retry_state)
             ^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/tenacity/__init__.py", line 398, in <lambda>
    self._add_action_func(lambda rs: rs.outcome.result())
                                     ^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/.pyenv/versions/3.11.9/lib/python3.11/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/.pyenv/versions/3.11.9/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/tenacity/__init__.py", line 478, in __call__
    result = fn(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Dev/OpenDevin/opendevin/llm/llm.py", line 154, in wrapper
    resp = completion_unwrapped(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/utils.py", line 1028, in wrapper
    raise e
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/utils.py", line 908, in wrapper
    result = original_function(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/main.py", line 2750, in completion
    raise exception_type(
          ^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/utils.py", line 8083, in exception_type
    raise e
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/utils.py", line 6357, in exception_type
    raise NotFoundError(
litellm.exceptions.NotFoundError: litellm.NotFoundError: OpenAIException - Error code: 404 - {'error': {'message': 'The model `gpt-4` does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}
16:09:52 - opendevin:ERROR: agent_controller.py:149 - Error while running the agent: litellm.NotFoundError: OpenAIException - Error code: 404 - {'error': {'message': 'The model `gpt-4` does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}
16:09:52 - opendevin:ERROR: agent_controller.py:150 - Traceback (most recent call last):
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/llms/openai.py", line 1032, in completion
    raise e
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/llms/openai.py", line 950, in completion
    self.make_sync_openai_chat_completion_request(
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/llms/openai.py", line 815, in make_sync_openai_chat_completion_request
    raise e
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/llms/openai.py", line 810, in make_sync_openai_chat_completion_request
    response = openai_client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/openai/_utils/_utils.py", line 277, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/openai/resources/chat/completions.py", line 646, in create
    return self._post(
           ^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/openai/_base_client.py", line 1266, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/openai/_base_client.py", line 942, in request
    return self._request(
           ^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/openai/_base_client.py", line 1046, in _request
    raise self._make_status_error_from_response(err.response) from None
openai.NotFoundError: Error code: 404 - {'error': {'message': 'The model `gpt-4` does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/main.py", line 1366, in completion
    raise e
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/main.py", line 1339, in completion
    response = openai_chat_completions.completion(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/llms/openai.py", line 1038, in completion
    raise OpenAIError(status_code=e.status_code, message=str(e))
litellm.llms.openai.OpenAIError: Error code: 404 - {'error': {'message': 'The model `gpt-4` does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/MY_USER/Dev/OpenDevin/opendevin/controller/agent_controller.py", line 143, in _start_step_loop
    await self._step()
  File "/Users/MY_USER/Dev/OpenDevin/opendevin/controller/agent_controller.py", line 400, in _step
    action = self.agent.step(self.state)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Dev/OpenDevin/agenthub/codeact_agent/codeact_agent.py", line 197, in step
    response = self.llm.completion(
               ^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/tenacity/__init__.py", line 336, in wrapped_f
    return copy(f, *args, **kw)
           ^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/tenacity/__init__.py", line 475, in __call__
    do = self.iter(retry_state=retry_state)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/tenacity/__init__.py", line 376, in iter
    result = action(retry_state)
             ^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/tenacity/__init__.py", line 398, in <lambda>
    self._add_action_func(lambda rs: rs.outcome.result())
                                     ^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/.pyenv/versions/3.11.9/lib/python3.11/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/.pyenv/versions/3.11.9/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/tenacity/__init__.py", line 478, in __call__
    result = fn(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Dev/OpenDevin/opendevin/llm/llm.py", line 154, in wrapper
    resp = completion_unwrapped(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/utils.py", line 1028, in wrapper
    raise e
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/utils.py", line 908, in wrapper
    result = original_function(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/main.py", line 2750, in completion
    raise exception_type(
          ^^^^^^^^^^^^^^^
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/utils.py", line 8083, in exception_type
    raise e
  File "/Users/MY_USER/Library/Caches/pypoetry/virtualenvs/opendevin-EIcOeD54-py3.11/lib/python3.11/site-packages/litellm/utils.py", line 6357, in exception_type
    raise NotFoundError(
litellm.exceptions.NotFoundError: litellm.NotFoundError: OpenAIException - Error code: 404 - {'error': {'message': 'The model `gpt-4` does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}

enyst · 2024-08-14T21:51:57Z

enyst
Aug 14, 2024
Collaborator

Hi @silversonicaxel, I don't fully understand, you're saying you try to follow a page in the documentation which is for local LLMs. But your error log shows Error code: 404 - {'error': {'message': 'The model gpt-4 does not exist, GPT-4 is not local, it's hosted.
If you want to use GPT-4, please check out the main Readme of this repository, and make sure you enter the exact model as OpenAI lists it, in the UI.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

How to have OpenDevin up and running? #3316

{{title}}

Replies: 1 comment

{{title}}

Select a reply

How to have OpenDevin up and running? #3316

silversonicaxel Aug 9, 2024

Replies: 1 comment

enyst Aug 14, 2024 Collaborator

silversonicaxel
Aug 9, 2024

enyst
Aug 14, 2024
Collaborator