Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enhance the implementation of the CUDA inference kernel. #118

Open
haruhi55 opened this issue Nov 13, 2024 · 2 comments
Open

Enhance the implementation of the CUDA inference kernel. #118

haruhi55 opened this issue Nov 13, 2024 · 2 comments
Assignees
@lcy-seso @ricor07
Labels
features

Comments

@haruhi55
Copy link

haruhi55 commented Nov 13, 2024 •
edited
Loading

Implement a dequantization (lookup) fused with the GEMM kernel.
@lcy-seso lcy-seso self-assigned this Nov 13, 2024
@ricor07
Copy link

ricor07 commented Dec 28, 2024

Hello, I'd be glad to work on this. Can i get the issue assigned? Thanks

@YangWang92
Copy link
Contributor

Thank you for your interest! We warmly welcome contributions to our project.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lcy-seso lcy-seso

@ricor07 ricor07

Labels
features
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@YangWang92 @lcy-seso @ricor07 @haruhi55