Improve observability; add sqlite retries to deal with sqlite_busy errors

[jlewi]

• Use the pragma sqlite_busy to add automatic retries on sqlite busy error

  • I was seeing high rates of sqlitebusy errors when deployed on K8s on Azure and this was causing learning to happen much less frequently then it should

• Clean up the prometheus metrics to support dashboards for monitoring impact. The key metrics we want are

  • Number of accepted suggestions
  • Number of executed cells
  • Number of learned examples

• Cleanup up prometheus metrics so we can better monitor why learning isn't happening; this was used to track down sqlite busy errors

• Support monitoring with Datadog

  • With Datadog structured logging we need to use the field "level" for severity or else it won't automatically parse that field
  • Udpate the configuration to allow the user to control what fields are used in the encoder

[standard-input]

No issues flagged.
Standard Input can make mistakes. Check important info.

[netlify]

✅ Deploy Preview for foyle ready!

Name	Link
🔨 Latest commit	2c346b6
🔍 Latest deploy log	https://app.netlify.com/sites/foyle/deploys/674faf66842bb40008a05a86
😎 Deploy Preview	https://deploy-preview-352--foyle.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.