@effect/ai-anthropic: using tool names with slashes (`test/mytool`) results in an opaque error

[dmaretskyi]

What version of Effect is running?

No response

What steps can reproduce the bug?

@effect/ai: 0.22.1
@effect/ai-anthropic 0.12.2

export class TestToolkit extends AiToolkit.make(
  AiTool.make('test/mytool', {
    description: '....',
    parameters: {
      query: Schema.String.annotations({
        description: '...',
      }),
    },
    success: Schema.Unknown,
    failure: Schema.Never,
  }),
) {}

Using anthropic client with this toolkit will throw an opaque http error. This is difficult to debug without tapping into the HTTP client.

What is the expected behavior?

A more specific error message is desired.

What do you see instead?

No response

Additional information

No response

[IMax153]

@dmaretskyi - I can see the specific error message when I run the program below.

import { AiLanguageModel, AiTool, AiToolkit } from "@effect/ai"
import { AnthropicClient, AnthropicLanguageModel } from "@effect/ai-anthropic"
import { NodeHttpClient } from "@effect/platform-node"
import { Config, Effect, Layer, Schema } from "effect"

export class TestToolkit extends AiToolkit.make(
  AiTool.make("test/mytool", {
    description: "A description",
    parameters: {
      query: Schema.String.annotations({
        description: "A description"
      })
    },
    success: Schema.Unknown,
    failure: Schema.Never
  })
) {}

export const TestToolkitLayer = TestToolkit.toLayer(
  Effect.gen(function*() {
    return {
      "test/mytool": ({ query }) => Effect.succeed(query)
    }
  })
)

const Claude37Sonnet = AnthropicLanguageModel.model("claude-3-7-sonnet-latest")

const program = AiLanguageModel.generateText({
  prompt: "Generate a random text query and use the tool",
  toolkit: TestToolkit,
  toolChoice: { tool: "test/mytool" }
}).pipe(Effect.provide(Claude37Sonnet))

const Anthropic = AnthropicClient.layerConfig({
  apiKey: Config.redacted("ANTHROPIC_API_KEY")
}).pipe(Layer.provide(NodeHttpClient.layerUndici))

program.pipe(
  Effect.provide([Anthropic, TestToolkitLayer]),
  Effect.runPromise
)

This looks like a limitation of Anthropic.

Are you unable to see the error message?

[dmaretskyi]

Are you unable to see the error message?

No, the error I've seen was something along the lines of "HTTP error: status code 4xx". I'll grab a snippet with the repro next time I see it.

Side note: LMStudio with running Gemini, has a similar issue with tool names, but instead of failing it suceeds with an empy response.

[dmaretskyi]

Do you think its reasonable for clients to validate tool-names client side?