Skip to content

@effect/ai-openrouter fails when running deepseek/deepseek-chat-v3.1 #5680

@ToliaGuy

Description

@ToliaGuy

What version of Effect is running?

latest

What steps can reproduce the bug?

When running deepseek/deepseek-chat-v3.1 model.

I get this (happens 70% of the time)

MalformedOutput
{ "module": "OpenRouterClient", "method": "streamRequest", "description": undefined, "cause": (parseJson <-> (@effect/ai-openrouter/ChatCompletionStreamDeltaEvent (Encoded side) <-> @effect/ai-openrouter/ChatCompletionStreamDeltaEvent) | (@effect/ai-openrouter/ChatCompletionStreamErrorEvent (Encoded side) <-> @effect/ai-openrouter/ChatCompletionStreamErrorEvent))
└─ Type side transformation failure
   └─ (@effect/ai-openrouter/ChatCompletionStreamDeltaEvent (Encoded side) <-> @effect/ai-openrouter/ChatCompletionStreamDeltaEvent) | (@effect/ai-openrouter/ChatCompletionStreamErrorEvent (Encoded side) <-> @effect/ai-openrouter/ChatCompletionStreamErrorEvent)
      ├─ (@effect/ai-openrouter/ChatCompletionStreamDeltaEvent (Encoded side) <-> @effect/ai-openrouter/ChatCompletionStreamDeltaEvent)
      │  └─ Encoded side transformation failure
      │     └─ @effect/ai-openrouter/ChatCompletionStreamDeltaEvent (Encoded side)
      │        └─ Encoded side transformation failure
      │           └─ Struct (Encoded side)
      │              └─ ["choices"]
      │                 └─ ReadonlyArray<(Struct (Encoded side) <-> Struct (Type side))>
      │                    └─ [0]
      │                       └─ (Struct (Encoded side) <-> Struct (Type side))
      │                          └─ Encoded side transformation failure
      │                             └─ Struct (Encoded side)
      │                                └─ ["logprobs"]
      │                                   └─ (ChatCompletionTokenLogprobs (Encoded side) <-> ChatCompletionTokenLogprobs) | null | undefined
      │                                      ├─ (ChatCompletionTokenLogprobs (Encoded side) <-> ChatCompletionTokenLogprobs)
      │                                      │  └─ Encoded side transformation failure
      │                                      │     └─ ChatCompletionTokenLogprobs (Encoded side)
      │                                      │        └─ ["content"]
      │                                      │           └─ is missing
      │                                      ├─ Expected null, actual {"tokens":null,"token_logprobs":null,"top_logprobs":null,"text_offset":null}
      │                                      └─ Expected undefined, actual {"tokens":null,"token_logprobs":null,"top_logprobs":null,"text_offset":null}
      └─ (@effect/ai-openrouter/ChatCompletionStreamErrorEvent (Encoded side) <-> @effect/ai-openrouter/ChatCompletionStreamErrorEvent)
         └─ Encoded side transformation failure
            └─ @effect/ai-openrouter/ChatCompletionStreamErrorEvent (Encoded side)
               └─ ["error"]
                  └─ is missing }

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions