Merge remote-tracking branch 'origin/main' into OPIK-444

apps/opik-backend/src/main/java/com/comet/opik/domain/TraceDAO.java

@@ -625,11 +625,13 @@ AND id IN (
                             FROM (
                                 SELECT
                                     trace_id,
-                                    sumMap(usage) as usage
+                                    sumMap(usage) as usage,
+                                    sum(total_estimated_cost) as total_estimated_cost
                                 FROM (
                                     SELECT
                                         trace_id,
-                                        usage
+                                        usage,
+                                        total_estimated_cost
                                     FROM spans
                                     WHERE workspace_id = :workspace_id
                                     AND project_id = :project_id

apps/opik-backend/src/test/java/com/comet/opik/api/resources/v1/priv/TracesResourceTest.java

@@ -6562,7 +6562,12 @@ void getTraceStats__whenFilterUsageEqual__thenReturnTracesFiltered(String usageK
                     .field(field)
                     .operator(Operator.EQUAL)
                     .value(traces.getFirst().usage().get(usageKey).toString())
-                    .build());
+                    .build(),
+                    TraceFilter.builder()
+                            .field(TraceField.TOTAL_ESTIMATED_COST)
+                            .operator(Operator.GREATER_THAN_EQUAL)
+                            .value("0.000")
+                            .build());
 
             List<ProjectStatItem<?>> stats = getProjectTraceStatItems(expectedTraces);
 

apps/opik-documentation/documentation/docs/changelog.md

@@ -10,12 +10,16 @@ sidebar_label: Changelog
 **Opik Dashboard**:
 
 - Feedback scores are now displayed as separate columns in the traces and spans table
+- Introduce a new project dashboard to see trace count, feedback scores and token count over time.
+  ![project dashboard](/img/changelog/2024-11-25/project_dashboard.png)
 - Project statistics are now displayed in the traces and spans table header, this is especially useful for tracking the average feedback scores
   ![project statistics](/img/changelog/2024-11-25/project_statistics.png)
 - Redesigned the experiment item sidebar to make it easier to review experiment results
   ![experiment item sidebar](/img/changelog/2024-11-25/experiment_item_sidebar.png)
 - Annotating feedback scores in the UI now feels much faster
+- Support exporting traces as JSON file in addition to CSV
 - Sidebars now close when clicking outside of them
+- Dataset groups in the experiment page are now sorted by last updated date
 - Updated scrollbar styles for Windows users
 
 **SDK**:

apps/opik-documentation/documentation/docs/cookbook/quickstart_notebook.md

@@ -41,9 +41,9 @@ import opik
 ITERATION_SUMMARY_PROMPT = opik.Prompt(
     name="Iteration Summary Prompt",
     prompt="""
-Document: {document}
-Current summary: {current_summary}
-Instruction to focus on: {instruction}
+Document: {{document}}
+Current summary: {{current_summary}}
+Instruction to focus on: {{instruction}}
 
 Generate a concise, entity-dense, and highly technical summary from the provided Document that specifically addresses the given Instruction.
 
@@ -58,8 +58,8 @@ Guidelines:
 FINAL_SUMMARY_PROMPT = opik.Prompt(
     name="Final Summary Prompt",
     prompt="""
-Given this summary: {current_summary}
-And this instruction to focus on: {instruction}
+Given this summary: {{current_summary}}
+And this instruction to focus on: {{instruction}}
 Create an extremely dense, final summary that captures all key technical information in the most concise form possible, while specifically addressing the given instruction.
 """.rstrip().lstrip(),
 )
@@ -128,7 +128,7 @@ def final_summary(instruction: str, current_summary: str, model: str = "gpt-4o-m
     )
 
 
-@opik.track
+@opik.track(project_name="Chain of Density Summarization")
 def chain_of_density_summarization(
     document: str,
     instruction: str,
@@ -149,8 +149,6 @@ Let's call the summarization chain with a sample document:
 ```python
 import textwrap
 
-os.environ["OPIK_PROJECT_NAME"] = "Chain of Density Summarization"
-
 document = """
 Artificial intelligence (AI) is transforming industries, revolutionizing healthcare, finance, education, and even creative fields. AI systems
 today are capable of performing tasks that previously required human intelligence, such as language processing, visual perception, and

apps/opik-documentation/documentation/docs/reference/rest_api/find-datasets.api.mdx

@@ -5,7 +5,7 @@ description: "Find datasets"
 sidebar_label: "Find datasets"
 hide_title: true
 hide_table_of_contents: true
-api: eJy1V21v2zYQ/is3Yh+2QLaTdC+AMGzI2q4LVmxFkmIYqsw5i2eLM0Wq5Cmu6/m/D0fJb02yBuj2xUrI43Nvz92RK8U4iyp/o54hYySO6jpTmmIZTMPGO5Wrn4zToDfbmfINBZS9c61yNTVOP9ttNhiwJqYgoCvlsCaVqwZnpDJlBO5tS2GpMhXLimpU+UrVxpm6rVV+kileNnLAOKYZBZWpqQ81crf05FSJcVNsLav8ZL3Othqief8/aDjeV7EwXI3pXUPB1OQ4jr2zy4d19nom3ltCp/aRmuDrhsdGf/R05GDcbN/ItjX6ACx9HomzXl9nKlBsvIsUZf/0+Fg+hxnv8wmBom9DKfCld0yORRabxpoyMWD0V5QDq7sK/eQvKlkIEYQvbDp1ezC9IIaAKYpMdRIJ9LY1gbSQMvl2nX0E1OhHRCzr43UnJB/QfaUaZKYgcfjih/jln0URj74oisvhUVFc/l0Ul1/KyucquwtUBkImPUb+V4M0Mg3YpLQFQv2b8Cjn0NIexmR5H8YdcYuRx22jP1nvAdAjle+KYVz69iCt95fXN1/dB9P3lnGiwCch1T7yOFApFu0Z98lx2STlP8FcZ4oNW9oV2vhVO7GmlLLuWuXHvH9yKnRLPe9xouwZ7WOCeo91r3BGOwvXIlETV166/4xSOSJXKlej25NRE8wtMo325kWkcLuZB22wKlcVc5OPRtaXaCsfOf/65NsnI2yM+nD2vBQR6BCUNL0dQMxHo8ViMSx9TSy/I9+Y+b0ovzVmDk+tb7WSBmjc1KdY9H6m7Yvnl1dw9ur8zuGriuBAAkyEsg2BHNslGAcTYgR0GmKbGhSwh7JCN6MhnE9h6Vuo8JYA3RLethQFOIIPMCXSEyzngBPfMnBFgh8zaCxhJAiEZQWy5R28MPxzO8lh4/vMcNVOkuMpBIPapggMC1e4M2vBTxNil6sI1kQmLfZyZSJoX7ZC5NTHAQNBG0nDZAlkuKKQzl4++0XslD9fn4tbwpuAJYMMw7SeQtMlaAhnEVCmRms5K9y+9hSACZED37CpzXvSMO2gY1I9KDFSFPNq4/Q2cGKY9X5u3CzJY48IXCFLJpznjWs48be0DV5Xs4WTxJgYW9oFUXwKaCIBwquLzyRgyQ3jSttqisALDzUaB5oa65cSp2S35C0p7nxM5kZrZpUwQZvplIQViSRtxBnlAj2Ao6NLstOBUJ009KoioyspPzqCP3wLC2MtRFM3dgmOSEuwY0OlmS678F+8BIxw82DpjL4jpxtvHI+lHL+/ESejqY3FMIQrSbmJCaq/3vQObbIghIjDztpdvRyYd59dSVT8/YWWqQbSwu8+zGODJXV0I6gINSU7CLqOs6FntwOx8q3VMOlCBnBzcyOflfwAFOppovgWt1A5FGrp2zBYbNYGMuALlW2OYMuVD+Z9YvjeAWzMYE7LQongeqtM/njmgXFOQiqxLFCXbbHzAG1j9S3aViJHHQ97/iT5mx8JAwW4gSbQ1LwbwpWHuDBcVhLDNgqjtxFMwd4E66A0s1QGJSb7SmvKufBYxEgbhknL7B1oExuLS9KwqMhB5W9JJhLItzdHauL1xcubPdkeKAiBoUodzGjaZKYnRH/5wzINvP7S+SI1H7igxkfDPl06D1vzQ+1JppE1JblIe3hnDZYVwenw+ACob/GYdoc+zEb90Th6ef70+a+Xzwenw+NhxbUVXBkzXdM+GR4Pj2Wp8ZFrdHuqPnzOfHD7295Q7wj2o5PpHY8ai8YJfrJ11U/AN+r2JN1O0wxU25tNelRJtYrIajXBSK+DXa9lubuyy2zUJuLEysV3ijZSpua03L2dEtVUrtIUfEC0fwQ9RvShx8xjzu4/Xx4j379QdqLX8k8wIqvyN9frTHX1lMLQnTkrS2p479SdV4egbO8hL55fqfX6Hy/YFfU=
+api: eJy1V21vGzcS/itT4j60xkqynb4Ai0MLX5LLGQ3awHZwOGRdebQcaVlxyQ05a0VR9d+L4a7eYrsRkN4XrU0On3l7ZoZcKcZZVPk79QIZI3FUt5nSFMtgGjbeqVz92zgNerOdKd9QQNm71CpXU+P0i91mgwFrYgoCulIOa1K5anBGKlNG4N63FJYqU7GsqEaVr1RtnKnbWuVnmeJlIweMY5pRUJma+lAjd0vPzpUYN8XWssrP1utsqyGaj/8HDaf7KhaGqzF9aCiYmhzHsXd2+bTOXs/Ee0vo1D5SE3zd8Njoz56OHIyb7RvZtkYfgKXPkTgHEfOBO+wjj95mKlBsvIsUZf/89FQ+h2TpqQCBom9DKZaV3jE5FllsGmvKRJ7R71EOrB4q9JPfqWThUhCqsenU7cH0ghgCpgQw1Ukk0PvWBNLC5+TlbfYZUKOPCHbWh+xBSD6plJVqkJmCxOHrn+I3vxVFPPm6KK6HJ0Vx/UdRXH8jK/9Q2UOgMhAy6THyXxqkkWnAJmU8EOpfhYI5h5b2MCbLxzAeiFuMPG4b/cV6D4COVL6ro3Hp24O0Pl6Z33/7GEzflsaJAl+EVPvI40ClWLRn3BfHZZOUvwVznSk2bGlXaOM37cSaUiq767Kf8/7ZudAttcvjRNkz2mOC+oh1b3BGOwvXIlETV14Gx4xSOSJXKlej+7NRE8w9Mo32Rk2kcL8ZJW2wKlcVc5OPRtaXaCsfOf/u7IdnI2yM+nRsvRYR6BCU9L0dQMxHo8ViMSx9TSy/I9+Y+aMovzZmDs+tb7WSBmjc1KdY9H6m7auX1zdw8ebyweGbiuBAAkyEsg2BHNslGAcTYgR0GmKbGhSwh7JCN6MhXE5h6Vuo8J4A3RLetxQFOIIPMCXSEyzngBPfMnBFgh8zaCxhJAiEZQWy5R28MvyfdpLDxveZ4aqdJMdTCAa1TREYFq5wF9aCnybELlcRrIlMWuzlykTQvmyFyKmPAwaCNpKGyRLIcEUhnb1+8bPYKX++vRS3hDcBSwaZo2k9haZL0BAuIqBMjdZyVrh97SkAEyIHvmFTm4+kYdpBx6R6UGKkKObVxult4MQw6/3cuFmSxx4RuEKWTDjPG9dw4u9pG7yuZgsniTExtrQLovgU0EQChDdXX0nAkhvGlbbVFIEXHmo0DjQ11i8lTsluyVtS3PmYzI3WzCphgjbTKQkrEknaiDPKBXoAJyfXZKcDoTpp6FVFRldSfnIC//MtLIy1EE3d2CU4Ii3Bjg2VZrrswn/1GjDC3ZOlM/onOd1443gs5fjjnTgZTW0shiHcSMpNTFD9zah3aJMFIUQcdtbu6uXAvMfsSqLi78+0TDWQFv7rwzw2WFJHN4KKUFOyg6DrOBt6djsQK99aDZMuZAB3d3fyWckPQKGeJ4pvcQuVQ6GWvg2DxWZtIAO+UNnmCLZc+WA+JobvHcDGDOa0LJQIrrfK5I8XHhjnJKQSywJ12RY7D9A2Vt+jbSVy1PGw50+Sv/sXYaAAd9AEmpoPQ7jxEBeGy0pi2EZh9DaCKdibYB2UZpbKoMRkX2lNORceixhpwzBpmb0DbWJjcUkaFhU5qPw9yUQC+fbmSE28vXp9tyfbAwUhMFSpgxlNm8z0hOgvf1imgdffO1+l5gNX1Pho2KdL52Frfqo9yTSypiQXaQ/vosGyIjgfnh4A9S0e0+7Qh9moPxpHry+fv/zl+uXgfHg6rLi2gitjpmvaZ8PT4aksNT5yjW5P1acvoU9uf9sb6gPBfnQyfeBRY9E4wU+2rvoJ+E7dn6XbaZqBanuzSe8xqVYRWa0mGOltsOu1LHdXdpmN2kScWLn4TtFGytSclrtnV6KaylWagk+I9u+nY0Sfegcdc3b/5XOMfP+4OcqD7XtmJ30r/wQj4ip/d7vOVFd9KWjdsYuypIb3Tj14owjK9tby6uWNWq//BBVDONg=
 sidebar_class_name: "get api-method"
 info_path: reference/rest_api/opik-rest-api
 custom_edit_url: null
@@ -48,7 +48,7 @@ Find datasets
 </Heading>
 
 <ParamsDetails
-  parameters={[{"name":"page","in":"query","schema":{"minimum":1,"type":"integer","format":"int32","default":1}},{"name":"size","in":"query","schema":{"minimum":1,"type":"integer","format":"int32","default":10}},{"name":"with_experiments_only","in":"query","schema":{"type":"boolean"}},{"name":"prompt_id","in":"query","schema":{"type":"string","format":"uuid"}},{"name":"name","in":"query","schema":{"type":"string"}}]}
+  parameters={[{"name":"page","in":"query","schema":{"minimum":1,"type":"integer","format":"int32","default":1}},{"name":"size","in":"query","schema":{"minimum":1,"type":"integer","format":"int32","default":10}},{"name":"with_experiments_only","in":"query","schema":{"type":"boolean"}},{"name":"prompt_id","in":"query","schema":{"type":"string","format":"uuid"}},{"name":"name","in":"query","schema":{"type":"string"}},{"name":"sorting","in":"query","schema":{"type":"string"}}]}
 >
 
 </ParamsDetails>

apps/opik-documentation/documentation/docs/reference/rest_api/get-project-metrics.api.mdx

@@ -5,7 +5,7 @@ description: "Gets specified metrics for a project"
 sidebar_label: "Get Project Metrics"
 hide_title: true
 hide_table_of_contents: true
-api: eJzNV1tvG7cS/itz+HQarC72SZCeRVFAsdXUsGsbso0itQx7tBxpWXPJLcmVogr678WQK0uyEzcPfagftGvu3OebC1ci4MyL/FZcOvs7FcGLu0xI8oVTdVDWiFx8pODB11SoqSIJFQWnCg9T6wChTmwiE7Ymh8xyIkUuZhRaib8kepGJGh1WFMixwpUwWJHIhZIiE4oV1RhKkQlHfzTKkRR5cA1lwhclVSjylQjLmjl8cMrMRCam1lUYRC6aRkmxXt8lZvLhg5VL5iisCWQCv2Jda1VEC3u/e/Zs9VK0nbTe1I79CYo8f00+3yeil3aQaSqO4U/D4fGHwdHp/dXRxWh4JTJxPRocDe+PLm7Or/m/i9Ph+f3N1eDjUNyt2etAbo76NZk/X9yMzj6JTBwPTuLz1+Hw9OzTHv+9D+jCqxGSGKgTVEVil4+M/FaudSaCCprp9hI7SgG/v2wmWhVivWZKR762xqfgHfb7/NgHVSsDtuj4h1LVAvJeve5ZQkz2b82sI9/o4HfY0TlccqUEqvzfhyEV13Pl64xTiq+J3VbfrYiZv8v+RlWk+mbszVE3u+SmqSbk9vB1jAEvrTLhPH7bgdaWZpQC9ArFM5QmQO7D9O2XkPkBJbSg/udQSc5Z9y3p3CRq15MhM/9C3uPshQNvXzpwbgP8ZBsj/+Xmp+orLY+L2sZoxwmQi978oFc7NcdAvbaefW+l5LpXPbULT26+mSSN0yIXZQh13utpW6AurQ/5u4P3/+thrcTziXbGJJAkiHW2K8Dnvd5isegWtqLAvz1bq8cvSrmo1SMcadtIwZOHYzraTp/hZ6xqTS+mxxdaybZZbHvC89YuDvuHbzv9953D/18fvMvfHeSH33f77w9+E8/b+dcpY1+a2lSzKTfRh9Hw6hoGlycvPLwuCfYoQHkoGufIBL0EZWBCAQGNBN9E5ECwUJRoZtSFkyksbQMlzgnQLCGGRlnjwTqYEskJFo+AE9sECCWxfJ9BrQk9gSMsSuBP1sBHFX5uJjlsEjRToWwmMTsxT51KxzR1x2ZsBlqDnUaJCV4etPKBJNsbSuVB2qKpyIRYC4COoPEkYbIEUqEkF3mvjk/ZTn69OWG3YpSxCLBQoYznMTQJRV0YeEBIbTsbm13tMQATIgO2DqpSf5KMy1MoyUfVnQI9eTavUkY+BY4N09Y+KjNrl60kEUKJgTNhbNi4hhM7p6fgFY4w0NhwYpT3DW2DyD45VJ4A4XL0Hw5YdEOZQjeSPISFhQqVAUm1tkuOU7Sb8xYVt6OJzfVazUpGglTTKTEqIkgarvScRXfgzZsr0tMO1yNJaFX5gKag/M0b+GQbWCitwauq1kswRJKDndbNZQr/6AzQw8NX67v3AxlZ88C45wby4wM76VWlNLouXHPKlY+iJE2x0RuHNllgQPhusnZb1HvmfcmuSMr+ntIy1kA8+NW6R19jQQluBCWhpGgHQRqJG3imL+BL22gJkxQygIeHB36s+AdgLI4ixJ/kjkUOY7G0jessNmcdHvdjkW1YsAmlderPiPAdBqxV55GWY8GE6ydl/HJsIeAjMajYMkcp22znnrSN1XGOg7SUcNjiJ9I/fCB05OABakdT9bkL1xb8QoWi5Bg2nhH9FMEY7E2w9kozi2VQYLSv0Kp4ZBwzGUkVYNKEYA1I5WuNS5KwKMlAaefEMwj42ZrDNXEzOnvYoW0FOQYwlLGDKUmbzLSAaAcoFmG7UomPsfnAiGrrVbCOx+D+/Phae+IGrFVBxtOOvEGNRUlw2O3vCWrnEMavXetmvZbV985OjobnV8POYbffLUOl41pFzqemfdDtd/t8xDO1QrNrOgV4uXjv9fydK9O3XvzauRboc+jVGpVh5dGRVTvQb8X8IO4UcaSn7SJdNjORx/vfZq7fZYJLm1lWqwl6unF6vebjPxpyS5Hf3vEK6RROeH7droRUnt+lyKeoPb3izn9H7Wr7HXzN6s12Yzip7aYqRCYeaZluqmtezlMFRO3pw1HS0blm9i3ji42LV43EMSgKqsOrtHc769HlxRXfMibtrbayknkcLvi6jItkZNul4xLPZyuh0cwanDFtksl/fwFtiXSG
+api: eJzVV91vGzcS/1fm+HQNVpLtJsjdoiigyGpq2LUNWUaRWoY9Wo60rLnkluRaUQX974chV5ZkJ24e+nD1g3bNne/5zQdXIuDci/xGXDr7OxXBi9tMSPKFU3VQ1ohcfKTgwddUqJkiCRUFpwoPM+sAoU5sIhO2JofMciJFLuYUWom/JHqRiRodVhTIscKVMFiRyIWSIhOKFdUYSpEJR380ypEUeXANZcIXJVUo8pUIy5o5fHDKzEUmZtZVGEQumkZJsV7fJmby4YOVS+YorAlkAr9iXWtVRAt7v3v2bPVStJ223tSO/QmKPH9NPt8lopd2kGkqjuFPw+Hxh/7g9O5qcDEaXolMjEf9wfBucHF9Pub/Lk6H53fXV/2PQ5GJ4+tRf3xycS4yMbi4GovbNcchkHtE/ZqWny+uR2efWED/JD5/HQ5Pzz7t8d/5gC68GjOJgTpBVSR2+cjIb+VaZyKooJluL9WjlIK7y2aqVSHWa6Z05GtrfArn0cEBP/Zh1sqALV7+puS1EL1Tr3uWMJT9c3LtyDc6+B12dA6XXE2BKv/XgUkF+Fz5OuMk42titxV6IyIWbrO/UBWpvhmNj6ibXXLTVFNye4g7xoCXVplwHr/tgG1LM0oBeoXiGW4TRPeB+/ZLWP2AElqY/304Jees+5Z0bhK168mQmX8h73H+woG3Lx04twF+so2R/+fmp3osLY+U2sZoxymRi97jYa926hED9doK972Vkute9dRAPLnHzbRpnBa5KEOo815P2wJ1aX3I3x2+/76HtRLPp94Zk0CSINbZrgCf93qLxaJb2IoC//ZsrR6+KOWiVg8w0LaRgqcTx3S0nVDDz1jVml5MmC80l22z2PaE581eHB0cve0cvO8c/Xd8+C5/d5gf/ad78P7wN/G8wX+dMvalmU01m3ITfRgNr8bQvzx54eG4JNijAOWhaJwjE/QSlIEpBQQ0EnwTkQPBQlGimVMXTmawtA2U+EiAZgkxNMoaD9bBjEhOsXgAnNomQCiJ5fsMak3oCRxhUQJ/sgY+qvBzM81hk6C5CmUzjdmJeepUOqapOzET09ca7CxKTPDyoJUPJNneUCoP0hZNRSbEWgB0BI0nCdMlkAoluch7dXzKdvLr9Qm7FaOMRYCFCmU8j6FJKOpC3wNCatvZxOxqjwGYEhmwdVCV+pNkXLBCST6q7hToybN5lTLyKXBsmLb2QZl5u5AliRBKDJwJY8PGNZzaR3oKXuEIA00MJ0Z539A2iOyTQ+UJEC5H/+KARTeUKXQjyUNYWKhQGZBUa7vkOEW7OW9RcTua2Fyv1bxkJEg1mxGjIoKk4UrPWXQH3ry5Ij3rcD2ShFaVD2gKyt+8gU+2gYXSGryqar0EQyQ52GklXabwj84APdx/tb57P5CRNQ+MO24gP96zk15VSqPrwphTrnwUJWmGjd44tMkCA8J3k7Xbot4z70t2RVL295SWsQbiwa/WPfgaC0pwIygJJUU7CNJI3MAzfQFf2kZLmKaQAdzf3/NjxT8AEzGIEH+SOxE5TMTSNq6z2Jx1eNxPRLZhwSaU1qk/I8J3GLBWnQdaTgQTrp+U8cuxhYAPxKBiyxylbLOde9I2Vsc5DtJSwmGLn0h//4HQkYN7qB3N1OcujC34hQpFyTFsPCP6KYIx2Jtg7ZVmFsugwGhfoVXxwDhmMpIqwLQJwRqQytcalyRhUZKB0j4SzyDgZ2sO18T16Ox+h7YV5BjAUMYOpiRtMtMCoh2gWITtSiU+xuYDI6qtV8E6HoP78+Nr7YkbsFYFGU878vo1FiXBUfdgT1A7hzB+7Vo377Wsvnd2MhieXw07R92DbhkqHdcqcj417cPuQfeAj3imVmh2TacAL1fxvZ6/c6361sthO9cCfQ69WqMyrDw6smoH+o14PIw7RRzpabtIF9JM5PGOuJnrt5ng0maW1WqKnq6dXq/5+I+G3FLkN7e8QjqFU55fNyshled3KfIZak+vuPPvUbvafgdfs3qz3RhOarupCpGJB1qm2+yal/NUAVF7+jBIOjpjZt8yvti4eNVIHP2ioDq8Snu7sx5d8r0iE9P25ltZyTwOF3ylxkUysu3ScYnns5XQaOYNzpk2yeS//wEzh32E
 sidebar_class_name: "post api-method"
 info_path: reference/rest_api/opik-rest-api
 custom_edit_url: null
@@ -55,15 +55,15 @@ Gets specified metrics for a project
 
 <RequestSchema
   title={"Body"}
-  body={{"content":{"application/json":{"schema":{"type":"object","properties":{"metric_type":{"type":"string","enum":["FEEDBACK_SCORES","TRACE_COUNT","TOKEN_USAGE"]},"interval":{"type":"string","enum":["HOURLY","DAILY","WEEKLY"]},"interval_start":{"type":"string","format":"date-time"},"interval_end":{"type":"string","format":"date-time"}},"title":"ProjectMetricRequest_Public"}}}}}
+  body={{"content":{"application/json":{"schema":{"type":"object","properties":{"metric_type":{"type":"string","enum":["FEEDBACK_SCORES","TRACE_COUNT","TOKEN_USAGE","DURATION","COST"]},"interval":{"type":"string","enum":["HOURLY","DAILY","WEEKLY"]},"interval_start":{"type":"string","format":"date-time"},"interval_end":{"type":"string","format":"date-time"}},"title":"ProjectMetricRequest_Public"}}}}}
 >
 
 </RequestSchema>
 
 <StatusCodes
   id={undefined}
   label={undefined}
-  responses={{"200":{"description":"Project Metrics","content":{"application/json":{"schema":{"type":"object","properties":{"project_id":{"type":"string","format":"uuid"},"metric_type":{"type":"string","enum":["FEEDBACK_SCORES","TRACE_COUNT","TOKEN_USAGE"]},"interval":{"type":"string","enum":["HOURLY","DAILY","WEEKLY"]},"results":{"type":"array","items":{"type":"object","properties":{"name":{"type":"string"},"data":{"type":"array","items":{"required":["time"],"type":"object","properties":{"time":{"type":"string","format":"date-time"},"value":{"type":"number"}},"title":"DataPointNumber_Public"}}},"title":"ResultsNumber_Public"}}},"title":"ProjectMetricResponse_Public"}}}},"400":{"description":"Bad Request","content":{"application/json":{"schema":{"type":"object","properties":{"errors":{"type":"array","items":{"type":"string"}}},"title":"ErrorMessage_Public"}}}},"404":{"description":"Not Found","content":{"application/json":{"schema":{"type":"object","properties":{"errors":{"type":"array","items":{"type":"string"}}},"title":"ErrorMessage_Public"}}}}}}
+  responses={{"200":{"description":"Project Metrics","content":{"application/json":{"schema":{"type":"object","properties":{"project_id":{"type":"string","format":"uuid"},"metric_type":{"type":"string","enum":["FEEDBACK_SCORES","TRACE_COUNT","TOKEN_USAGE","DURATION","COST"]},"interval":{"type":"string","enum":["HOURLY","DAILY","WEEKLY"]},"results":{"type":"array","items":{"type":"object","properties":{"name":{"type":"string"},"data":{"type":"array","items":{"required":["time"],"type":"object","properties":{"time":{"type":"string","format":"date-time"},"value":{"type":"number"}},"title":"DataPointNumber_Public"}}},"title":"ResultsNumber_Public"}}},"title":"ProjectMetricResponse_Public"}}}},"400":{"description":"Bad Request","content":{"application/json":{"schema":{"type":"object","properties":{"errors":{"type":"array","items":{"type":"string"}}},"title":"ErrorMessage_Public"}}}},"404":{"description":"Not Found","content":{"application/json":{"schema":{"type":"object","properties":{"errors":{"type":"array","items":{"type":"string"}}},"title":"ErrorMessage_Public"}}}}}}
 >
 
 </StatusCodes>

apps/opik-documentation/documentation/docs/tracing/production_monitoring.md

@@ -0,0 +1,81 @@
+---
+sidebar_position: 1
+sidebar_label: Production Monitoring
+toc_min_heading_level: 2
+toc_max_heading_level: 4
+---
+
+# Production Monitoring
+
+Opik has been designed from the ground up to support high volumes of traces making it the ideal tool for monitoring your production LLM applications.
+
+You can use the Opik dashboard to review your feedback scores, trace count and tokens over time at both a daily and hourly granularity.
+
+![Opik monitoring dashboard](/img/tracing/opik_monitoring_dashboard.png)
+
+In addition to viewing scores over time, you can also view the average feedback scores for all the traces in your project from the traces table.
+
+## Logging feedback scores
+
+To monitor the performance of your LLM application, you can log feedback scores using the [Python SDK and through the UI](/tracing/annotate_traces.md).
+
+### Logging feedback scores alongside traces
+
+Feedback scores can be logged while you are logging traces:
+
+```python
+from opik import track, opik_context
+
+@track
+def llm_chain(input_text):
+    # LLM chain code
+    # ...
+
+    # Update the trace
+    opik_context.update_current_trace(
+        feedback_scores=[
+            {"name": "user_feedback", "value": 1.0, "reason": "The response was helpful and accurate."}
+        ]
+    )
+```
+
+### Updating traces with feedback scores
+
+You can also update traces with feedback scores after they have been logged. For this we are first going to fetch all the traces using the search API and then update the feedback scores for the traces we want to annotate.
+
+#### Fetching traces using the search API
+
+You can use the [`Opik.search_traces`](https://www.comet.com/docs/opik/python-sdk-reference/Opik.html#opik.Opik.search_traces) method to fetch all the traces you want to annotate.
+
+```python
+import opik
+
+opik_client = opik.Opik()
+
+traces = opik_client.search_traces(
+    project_name="Default Project",
+    start_time="2024-01-01",
+    end_time="2025-01-01",
+)
+```
+
+:::tip
+
+The `search_traces` method allows you to fetch traces based on any of trace attributes, you can learn more about the different search parameters in the [search traces documentation](/tracing/export_data.md).
+
+:::
+
+#### Updating feedback scores
+
+Once you have fetched the traces you want to annotate, you can update the feedback scores using the [`Opik.log_traces_feedback_scores`](https://www.comet.com/docs/opik/python-sdk-reference/Opik.html#opik.Opik.log_traces_feedback_scores) method.
+
+```python
+for trace in traces:
+    opik_client.log_traces_feedback_scores(
+        project_name="Default Project",
+        trace_ids=[i.id],
+        feedback_scores=[{"name": "user_feedback", "value": 1.0, "reason": "The response was helpful and accurate."}],
+    )
+```
+
+You will now be able to see the feedback scores in the Opik dashboard and track the changes over time.

apps/opik-documentation/documentation/sidebars.ts

@@ -30,6 +30,7 @@ const sidebars: SidebarsConfig = {
         "tracing/log_multimodal_traces",
         "tracing/log_distributed_traces",
         "tracing/annotate_traces",
+        "tracing/production_monitoring",
         "tracing/sdk_configuration",
         "tracing/export_data",
         {