Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Add human feedback notebook tutorial #4257

Merged
merged 2 commits into from
Aug 16, 2024

Conversation

anticorrelator
Copy link
Contributor

resolves #4197

This adds an end-to-end tutorial on how to build a manually-instrumented chatbot with user feedback. This feedback is recorded as a SpanAnnotation and automatically associated with the span that instrumented the generation of the chatbot response.

These annotations are directly viewable in the Phoenix UI.

@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Aug 15, 2024
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@anticorrelator anticorrelator merged commit d4c200f into main Aug 16, 2024
11 checks passed
@anticorrelator anticorrelator deleted the dustin/human-feedback-notebook branch August 16, 2024 14:45
fjcasti1 added a commit that referenced this pull request Aug 16, 2024
* main: (58 commits)
  Update OpenAPI spec (#4260)
  Default to adding span annotations to queue (#4259)
  docs: Add human feedback notebook tutorial (#4257)
  refactor: daemon task abstraction (#4255)
  feat(auth): create system key (#4235)
  chore: add vision fixture (#4250)
  docs: fix variable name typo in run experiments doc (#4249)
  build(deps): bump certifi (#4147)
  chore(main): release arize-phoenix 4.24.0 (#4225)
  chore(main): release arize-phoenix-evals 0.15.0 (#3920)
  feat(experiments): ability to specify concurrency in run_experiment and evaluate_experiment (#4189)
  ci(evals): limit `mistralai` below version 1.0 (#4241)
  feat(auth): user / system api key resolvers (#4232)
  feat(auth): add user role, exclude system in user lists (#4229)
  docs: Add multimodal image reasoning tutorial with llama index (#4210)
  chore(main): release arize-phoenix 4.23.0 (#4216)
  docs: No subject (GITBOOK-818)
  build(deps): bump streamlit (#4214)
  fix: Propagate span annotation metadata to examples on all mutations (#4195)
  feat(auth): users table in settings (#4221)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[docs][annotations] annotations notebook and nbconvert
2 participants