Skip to content

Commit

Permalink
ci: stub out open AI key during CI to avoid embedding model downloads…
Browse files Browse the repository at this point in the history
… in llama_index (#1661)

* ci: high watermark on CI

* Reformat text

* adjust watermark

* fake openai key
  • Loading branch information
mikeldking authored Oct 24, 2023
1 parent e9f92f7 commit 67c1c26
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 3 deletions.
1 change: 1 addition & 0 deletions .github/workflows/python-CI.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ concurrency:

env:
pip-version: 23.1.2
OPENAI_API_KEY: "sk-fake-openai-key" # fake openai key so that llama_index doesn't download huggingface embeddings

jobs:
lint:
Expand Down
6 changes: 3 additions & 3 deletions src/phoenix/trace/evaluation_conventions.py
Original file line number Diff line number Diff line change
Expand Up @@ -14,13 +14,13 @@
EVAL_DOCUMENTS_PRECISION = "eval.documents_precision"
"""
The precision of a retriever.
This is the proportion (expressed as a value between 0 and 1) of relevant documents over the total
This is the proportion (expressed as a value between 0 and 1) of relevant documents over the total.
"""

EVAL_DOCUMENTS_PRECISION_AT_K_TEMPLATE = "eval.documents_precision_at_{k}"
"""
The prefix given to an evaluation metric that captures the precision of a
retriever up to K. E.x. you would have eval.documents_precision_at_1,
eval.documents_precision_at_2, etc. This value
would be computed on top of the document_relevancy attribute of each document.
eval.documents_precision_at_2, etc. This value would be computed on top of the
document_relevancy attribute of each document.
"""

0 comments on commit 67c1c26

Please sign in to comment.