Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add support for echoing requests #107

Merged
merged 2 commits into from
Oct 14, 2024
Merged

feat: add support for echoing requests #107

merged 2 commits into from
Oct 14, 2024

Conversation

quitrk
Copy link
Collaborator

@quitrk quitrk commented Oct 14, 2024

  • useful for testing the impact of code changes between two different deployments with the same traffic data

* useful for testing the impact of code changes between two different deployments with the same traffic data
@quitrk quitrk requested a review from saghul October 14, 2024 09:26
skynet/modules/ttt/summaries/app.py Outdated Show resolved Hide resolved
skynet/modules/ttt/summaries/app.py Outdated Show resolved Hide resolved
@quitrk quitrk merged commit a1a074b into master Oct 14, 2024
@quitrk quitrk deleted the tavram/echo branch October 14, 2024 10:39
shooding added a commit to shooding/skynet that referenced this pull request Nov 26, 2024
* master: (61 commits)
  deps: use pypi provided silero vad, upgrade to latest
  fix: remove public key validation (jitsi#123)
  fix: downgrade vllm (jitsi#122)
  feat: add fallback folder when looking up public keys (jitsi#119)
  fix: add ffmpeg dependency for pytorch
  ref: bypass queueing jobs with invalid payload (jitsi#121)
  fix: replace examplar usage with label for app_id
  feat: add instrumentation for app_id (jitsi#118)
  fix: re-enable vLLM multiprocessing (jitsi#116)
  fix: update incorrect prompt example
  fix: healthchecks failing due to missing internal id (jitsi#115)
  feat(openai-api) use Ollama for local development
  feat: expose openai api endpoints from vllm (jitsi#112)
  feat: update text hint type prompting (jitsi#111)
  feat: add meeting hint type and use it as default (jitsi#110)
  feat: enable requests batching (jitsi#109)
  metrics: add full duration metric
  metrics: add a skipped job status which will not count towards duration metrics
  fix: catch exceptions when echoing fails
  feat: add support for echoing requests (jitsi#107)
  ...

# Conflicts:
#	Dockerfile
#	Makefile
#	requirements.txt
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants