Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Separate selectable model name required in administration artificial intelligence dashboard #78

Open
ga-it opened this issue Apr 21, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@ga-it
Copy link

ga-it commented Apr 21, 2024

Which version of assistant are you using?

1.08

Which version of Nextcloud are you using?

28.0.1

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

Chrome 123.0.6312.123

Describe the Bug

Current Artificial Intelligence administration dashboard has "LocalAI integration" next to tasks.

This seems to embed models like whisper1, stablediffussion, etc or makes the default model chosen in the Connected Accounts.

Here for example is the error when the assistant passes an image generation request via a LocalAI definition to LiteLLM

[integration_openai] Warning: API request error : Server error: POST http://xxxx:4000/v1/images/generations resulted in a 500 Internal Server Error response:
{"error":{"message":"'model'","type":"None","param":"None","code":500}}

POST /ocs/v2.php/apps/assistant/api/v1/i/process_prompt
from yyyy by zzzzzzz at 21 Apr 2024, 12:46:34

If you use a different model via LocalAI or LiteLLM, etc then you have to create aliasing for the model to match Nextcloud expectations.

Expected Behavior

Ideally, replace AI tasks like "Task: Generate headline" with Nextcloud CustomGPTs and user callable connected account (e.g. OpenAI, LocalAi) and model selection with defaults (i.e. default selected via admin interface could be Llama and via permissions, user could select GPT4 for customGPT over this if allowed).

As interim, separate connected account (OpenAI, LocalAI) and model selection (e.g. whisper1, stablediffusion)

To Reproduce

Current "settings/admin/ai" interface has no ability to select model

@ga-it ga-it added the bug Something isn't working label Apr 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant