[Feat] Proxy - Add Spend tracking logs

[ishaan-jaff]

The following fields get logged

model LiteLLM_SpendLogs {
  request_id          String @unique
  api_key             String  @default ("")
  call_type           String
  spend               Float    @default(0.0)
  startTime           DateTime // Assuming start_time is a DateTime field
  endTime             DateTime // Assuming end_time is a DateTime field
  model               String   @default("")
  user                String   @default("")
  modelParameters     Json     @default("{}")// Assuming optional_params is a JSON field
  messages            Json     @default("[]")
  response            Json     @default("{}")
  usage               Json     @default("{}")
  metadata            Json     @default("{}")
  cache_hit           String   @default("")
}

[railway-app]

This PR is being deployed to Railway 🚅

litellm: ◻️ REMOVED

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jan 18, 2024 9:41pm

[ishaan-jaff]

Remaining:

• Add e2e testing for writing costs for /chat/completions (non-stream), /chat/completions (stream), /embeddings
• Add support for dynamoDB cost tracking

[ishaan-jaff]

update - we need to have api_key be a column !

[ishaan-jaff]

will merge after this passes testing