Replies: 1 comment
-
anthropic tool uses xml and reformats it as json. its all a lie |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I didn't see this in the docs. I've noticed that the LLM (Claude in this case) is responding with formatted/indented JSON. It wastes precious tokens to respond with whitespace in the JSON. When I hand-format prompts, I ask it to respond with JSON without whitespace to save on the newline and indent tokens, but in my first attempt at doing the same in Anthropic's Claude, it didn't seem to work. I'm going to iterate more and try other LLMs, but I thought I'd ask because I can't be the only one.
Beta Was this translation helpful? Give feedback.
All reactions