improve openai inference history storage

[jairad26]

sample stored now

{
                "id": "inf-018fca58-4291-75c8-921c-0118edec35ab",
                "modelHash": "46df2e17973a794cca48d0312743c0374ecaf3b1fb80b33c60f2135f676244fb",
                "input": "{\"model\": \"gpt-3.5-turbo\", \"messages\": [{\"role\": \"system\", \"content\": \"a word that rhymes with food\"}, {\"role\": \"user\", \"content\": \"a word that rhymes with food\"}], \"response_format\": {\"type\": \"text\"}}",
                "output": "{\"error\": {\"code\": \"\", \"type\": \"\", \"param\": \"\", \"message\": \"\"}, \"choices\": [{\"message\": {\"role\": \"assistant\", \"content\": \"mood\"}}]}",
                "startedAt": "2024-05-30T09:32:12.063-07:00",
                "duration": 633
            },
            {
                "id": "inf-018fca58-5626-7280-a6c5-c4c43e7666e5",
                "modelHash": "46df2e17973a794cca48d0312743c0374ecaf3b1fb80b33c60f2135f676244fb",
                "input": "{\"model\": \"gpt-3.5-turbo\", \"messages\": [{\"role\": \"system\", \"content\": \"Only respond with valid JSON object in this format:\\n{\\\"id\\\":\\\"123\\\",\\\"name\\\":\\\"Shoes\\\",\\\"price\\\":50.0,\\\"description\\\":\\\"Great shoes for walking.\\\"}\\nGenerate a product for the category provided.\"}, {\"role\": \"user\", \"content\": \"food\"}], \"response_format\": {\"type\": \"json_object\"}}",
                "output": "{\"error\": {\"code\": \"\", \"type\": \"\", \"param\": \"\", \"message\": \"\"}, \"choices\": [{\"message\": {\"role\": \"assistant\", \"content\": \"{\\\"id\\\":\\\"456\\\",\\\"name\\\":\\\"Banana\\\",\\\"price\\\":0.50,\\\"description\\\":\\\"Fresh and delicious ripe banana.\\\"}\"}}]}",
                "startedAt": "2024-05-30T09:32:12.064-07:00",
                "duration": 1017
            }

[linear]

HYP-1271 Inference history output JSON are escaped twice

"{\"Data\":{\"choices\":[{\"message\":{\"role\":\"assistant\",\"content\":\"{\\\"list\\\":[\\n    {\\\"target\\\":\\\"somevalue\\\",\\\"source\\\":\\\"JSON_BODY\\\",\\\"comparison\\\":\\\"EQUALS\\\",\\\"property\\\":\\\"$.test\\\"},\\n    {\\\"target\\\":\\\"success\\\",\\\"source\\\":\\\"JSON_BODY\\\",\\\"comparison\\\":\\\"EQUALS\\\",\\\"property\\\":\\\"$.result\\\"},\\n    {\\\"target\\\":20,\\\"source\\\":\\\"JSON_BODY\\\",\\\"comparison\\\":\\\"EQUALS\\\",\\\"property\\\":\\\"$.score\\\"},\\n    {\\\"target\\\":100,\\\"source\\\":\\\"JSON_BODY\\\",\\\"comparison\\\":\\\"EQUALS\\\",\\\"property\\\":\\\"$.riskLevel\\\"},\\n    {\\\"target\\\":30,\\\"source\\\":\\\"JSON_BODY\\\",\\\"comparison\\\":\\\"GREATER THAN\\\",\\\"property\\\":\\\"$.score\\\"},\\n    {\\\"target\\\":80,\\\"source\\\":\\\"JSON_BODY\\\",\\\"comparison\\\":\\\"LESS THAN\\\",\\\"property\\\":\\\"$.riskLevel\\\"}\\n]}\"}}],\"error\":{\"message\":\"\",\"type\":\"\",\"param\":\"\",\"code\":\"\"}},\"StartTime\":\"2024-05-29T21:25:20.905982971Z\",\"EndTime\":\"2024-05-29T21:25:23.759415349Z\"}"

Should only be escaped once