Skip to content

Issues: microsoft/VPTQ

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

14 Open 32 Closed
14 Open 32 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Question about fine-tuning alogrithm enhancement New feature or request question Further information is requested
#136 opened Dec 3, 2024 by kimwin2
4
How to dequantize a model with 4 groups and centroids greater than 4096? bug Something isn't working question Further information is requested
#128 opened Nov 29, 2024 by ShawnzzWu
6
How to Generate a 2-bit Quantized Meta-Llama-3.1-8B-Instruct Model? question Further information is requested
#126 opened Nov 21, 2024 by ForAxel
@YangWang92
7
Enhance the implementation of the CUDA inference kernel. features
#118 opened Nov 13, 2024 by haruhi55
@lcy-seso @ricor07
2
CPU support inference inference related questions
#114 opened Nov 7, 2024 by YangWang92
@YangWang92
Custom Model support new models require new models question Further information is requested
#113 opened Nov 7, 2024 by huangtingwei9988
3
Add evaluation codes enhancement New feature or request
#102 opened Oct 31, 2024 by YangWang92
Add FP8/INT8 support alogrithm
#88 opened Oct 26, 2024 by YangWang92
@YangWang92
3
Improve hessian/invhessian collection alogrithm
#79 opened Oct 21, 2024 by YangWang92
@YangWang92
3
Add Ollama/llama.cpp/ggml support inference inference related questions
#77 opened Oct 20, 2024 by YangWang92
@YangWang92
Add VLM/Multimodality support alogrithm new models require new models
#76 opened Oct 20, 2024 by YangWang92
@YangWang92
Add vLLM support inference inference related questions
#75 opened Oct 20, 2024 by YangWang92
@YangWang92
2
Does not work in Oobabooga inference inference related questions question Further information is requested
#53 opened Oct 8, 2024 by Kaszebe
1
stdout captures and injects userwarnings into TextStreamer question Further information is requested
#42 opened Oct 5, 2024 by JoeHelbing
3
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.