Skip to content

Pull requests: predibase/lorax

New pull request New
26 Open 467 Closed
26 Open 467 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add support for flash decoding
#751 opened Jan 28, 2025 by ajtejankar Loading…
Add ability to specify revision in model_id flag using model@revision format
#750 opened Jan 27, 2025 by joseph-predibase Loading…
@joseph-predibase
build and push dev image
#747 opened Jan 23, 2025 by magdyksaleh Loading…
Add LGAI-EXAONE-3.5 model
#744 opened Jan 20, 2025 by sadra-barikbin Loading…
1
Dynamic scaling + Other stuff (DONT MERGE - SPLIT INTO SMALLER PRS)
#737 opened Jan 10, 2025 by ajtejankar Loading…
1
Allow max_batch_prefill_tokens to be less than max_input_length
#736 opened Jan 9, 2025 by ajtejankar Loading…
Add eager flag and set compile to be always true
#734 opened Jan 9, 2025 by ajtejankar Loading…
8
int: Enable manual trigger for server tests wf
#696 opened Nov 25, 2024 by jeffreyftang Loading…
optimize healthcheck
#664 opened Nov 1, 2024 by noyoshi Loading…
3 tasks
Allow adapter loading for VLMs
#659 opened Oct 29, 2024 by Infernaught • Draft
1
arc runner: v2
#647 opened Oct 16, 2024 by noyoshi Loading…
3 tasks
Otel v2
#642 opened Oct 15, 2024 by noyoshi Loading…
3 tasks
Updated the documentaion about status code
#575 opened Aug 14, 2024 by Jatintalreja0510 Loading…
3 tasks
1
otel fixups
#572 opened Aug 9, 2024 by noyoshi Loading…
LORAX_USE_GLOBAL_HF_TOKEN to be applied correctly even though request doesn't have api_token
#542 opened Jul 16, 2024 by monologg Loading…
3 tasks
1
Refactor the lora load function for clarity and simplicity
#529 opened Jun 27, 2024 by ajtejankar Loading…
Fix: Use correct local path when loading base model from s3
#528 opened Jun 27, 2024 by fadebek Loading…
WIP - Runpod integration
#522 opened Jun 20, 2024 by noyoshi Loading…
try s3 crt
#519 opened Jun 18, 2024 by noyoshi Loading…
1
integration test POC
#517 opened Jun 14, 2024 by noyoshi Loading…
(WIP) Support targeting the embedding layer for LoRA
#501 opened Jun 6, 2024 by ajtejankar Loading…
1
@ajtejankar
14
feat: support loading eetq quantized model
#393 opened Apr 5, 2024 by thincal • Draft
3 tasks
1
4
(WIP) snowflake endpoint POC
#338 opened Mar 19, 2024 by noyoshi Loading…
1
Batch prefill tokens uses max input tokens as default
#320 opened Mar 11, 2024 by noyoshi Loading…
2
Streamlit frontend to query models
#257 opened Feb 17, 2024 by magdyksaleh • Draft
6 tasks
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.