Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot select devices by gpu_device. #2668

Closed
Masa-tam opened this issue Dec 25, 2024 · 3 comments · Fixed by #2728
Closed

Cannot select devices by gpu_device. #2668

Masa-tam opened this issue Dec 25, 2024 · 3 comments · Fixed by #2728

Comments

@Masa-tam
Copy link

Since 1.7.3, whisper.cpp uses the first device in the device list without looking at the value of gpu_device.
I was able to fix it with the following modification, but I am not sure if it is correct or not.

First, take a count in “static ggml_backend_t whisper_backend_init_gpu(const whisper_context_params & params)” and select a device.
Then, in “static ggml_backend_buffer_type_t whisper_default_buffer_type(const whisper_context_params & params)”, the device is selected by the same count.

@xaionaro
Copy link

Having the same problem. Downgrade to 1.7.2 helped, thanks for the hint.

@ggerganov
Copy link
Owner

Could you test if #2728 fixes the issue?

@xaionaro
Copy link

Could you test if #2728 fixes the issue?

It did fix the issue in my setup. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants