Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add docs for permission in 03 and add enable_trace in 04 #21

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -134,9 +134,11 @@
# MAGIC %md
# MAGIC ## Grant stakeholders access to the Review App
# MAGIC
# MAGIC Now, grant your stakeholders permissions to use the Review App. Your stakeholders do not Databricks accounts as long as you have [insert docs].
# MAGIC Now, grant your stakeholders permissions to use the Review App. Your stakeholders do not need to have Databricks accounts. From the documentation:
# MAGIC
# MAGIC `#TODO: add docs link`
# MAGIC > If reviewers don’t have access already, account admins can use account-level SCIM provisioning to sync users and groups automatically from your identity provider to your Databricks account. You can also manually register these users and groups as you set up identities in Databricks. This allows them to be included as eligible reviewers.
# MAGIC
# MAGIC [Refer to documentation here](https://docs.databricks.com/en/generative-ai/agent-evaluation/human-evaluation.html#set-up-permissions-to-the-review-app-workspace).

# COMMAND ----------

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -108,6 +108,21 @@
F.col("is_correct"),
))

# COMMAND ----------
# MAGIC %md
# MAGIC ## Ingest chats into the Review App to be reviewed

# COMMAND ----------

from databricks.agents import enable_trace_reviews

request_id_list = request_log_df.toPandas()["databricks_request_id"].tolist()

enable_trace_reviews(
model_name=UC_MODEL_NAME,
request_ids=request_id_list
)

# COMMAND ----------

# MAGIC %md
Expand Down