Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add exaone pretty please? #1836

Open
BBC-Esq opened this issue Dec 18, 2024 · 0 comments
Open

add exaone pretty please? #1836

BBC-Esq opened this issue Dec 18, 2024 · 0 comments

Comments

@BBC-Esq
Copy link

BBC-Esq commented Dec 18, 2024

These are excellent models, and they've recently been added to awq so as to maximize compatibility. Beats out Qwen 2.5 even in my custom RAG benchmark. I've tested the version 3.5 of exaone, but apparently they've released a 3.0 awhile back:

https://huggingface.co/LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct

https://github.com/casper-hansen/AutoAWQ/releases/tag/v0.2.7.post3

apparently people confuse it with llama's architecture, but see the nuances here:

huggingface/transformers#34652

HF being jerks about adopting it, but I figured ctranslate2 can!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant