Skip to content

Issues: predibase/lorax

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

145 Open 120 Closed
145 Open 120 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Outdated Endpoint URL in clients/python/README.md
#775 opened May 29, 2025 by kaushikacharya
4 tasks
Kernel issues, with docker image:main
#768 opened Apr 2, 2025 by gane5hvarma
2 of 4 tasks
Potential race condition
#767 opened Mar 27, 2025 by xingjianan
4 tasks
1
return_k_alternatives param causing validation error
#764 opened Mar 6, 2025 by mrcchef
4 tasks
1
Deprecate max_tokens in favor of max_completion_tokens
#763 opened Mar 5, 2025 by Infernaught
Support for DeepSeek-based models
#761 opened Mar 4, 2025 by kobiche
Beam search support
#755 opened Feb 3, 2025 by mrcchef
1
Plans for adding Qwen2VL model?
#754 opened Jan 31, 2025 by ashwani-bhat
2 tasks done
Lorax-launcher version
#745 opened Jan 21, 2025 by neelnj
Add model LGAI-EXAONE/EXAONE
#743 opened Jan 20, 2025 by sadra-barikbin
2 tasks done
1
Getting error with LoRA adapters for Qwen 2.5 0.5B Instruct
#733 opened Jan 9, 2025 by iddogino
2 of 4 tasks
Quantization appears to be broken, at least for AWQ and BnB
#722 opened Dec 21, 2024 by codybum
2 of 4 tasks
5
Not able to preload local adapters
#699 opened Nov 28, 2024 by xyang16
2 of 4 tasks
Attention not working properly in FlashRobertaModel and FlashBertModel
#694 opened Nov 22, 2024 by sgiorgis
2 of 4 tasks
why prune in mergeStrategy no rescale remaining?
#685 opened Nov 19, 2024 by zhujianwei-ops
Not able to host Llama3.2-11b on Azure A100 80GB server
#679 opened Nov 13, 2024 by alokgupta1996
2 of 4 tasks
2
Cannot run a FP8 quantized model with LoraX
#671 opened Nov 11, 2024 by Aktsvigun
2 of 4 tasks
6
Throughput and Latency degradation with a single LoRA adapter on A100 40 GB
#670 opened Nov 8, 2024 by kaushikmitr
2 of 4 tasks
1
Multi-responses for a single inference
#665 opened Nov 5, 2024 by mrcchef
Things started failing after new commit into main
#661 opened Oct 30, 2024 by gane5hvarma
2 of 4 tasks
2
Issue: recognizing a base causal language model as an embedding model
#657 opened Oct 24, 2024 by veezbo
2 of 4 tasks
1
Unexpected response with long-context model (Phi-3)
#651 opened Oct 17, 2024 by prd-tuong-nguyen
2 of 4 tasks
Phi 3.5 vision (4B model) enhancement New feature or request
#637 opened Oct 8, 2024 by CheeseAndMeat
2 tasks done
4
Not able to run source code
#636 opened Oct 8, 2024 by nirvitarka
2 of 4 tasks
Performance issues on AWQ and Lora
#611 opened Sep 18, 2024 by dumbPy
2 of 4 tasks
ProTip! Exclude everything labeled bug with -label:bug.