Azure Assistants Retrieval #5163
Unanswered
DanielJSimons
asked this question in
Troubleshooting
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Looking through a few of the threads and it is apparent that whilst retrieval for Azure Assistants isn't expected to be update any time soon a few of you have got this working on older versions. Is this functionality possible on older versions or is it completely deprecated now in favour for agents?
TIA
I am able to use code interpreter like normal and as expected, I am also able to select Retrieval but upon saving the assistant I a met with the error:
"400 Azure OpenAI Retrieval v1 tool is not supported in favor of the more advanced v2 file_search tool. Please use
file_searchin the v2 api."
However, when switching to V2, and listing "file_search" within capabilities the azure assistants are missing entirely.
I have tried:
Updating config.ts to:
[EModelEndpoint.azureAssistants]: '/api/assistants/v2/chat',
Using an older version of gpt-4o:
version: "2024-02-15-preview"
Here is the current relevant set up for librechat.yaml
`endpoints:
azureAssistants:
capabilities: ["code_interpreter", "image_vision", "retrieval", "actions", "tools"]
retrievalModels: ["gpt-4o"]
azureOpenAI:
titleModel: "gpt-4o-mini"
plugins: true
assistants: true
summarize: true
summaryModel: "gpt-4o-mini"
titleConvo: true
titleMethod: "completion"
groups:
- group: "default"
apiKey: "REDACTED"
instanceName: "REDACTED"
addParams:
max_tokens: 4096
temperature: 0.7
dropParams:
- "frequency_penalty"
- "presence_penalty"
forcePrompt: false
assistants: true
models:
gpt-4o-mini:
deploymentName: "REDACTED-gpt-4o-mini"
version: "2024-05-01-preview"
gpt-4o:
deploymentName: "REDACTED-poc-gpt-4o"
version: "2024-05-01-preview"`
Beta Was this translation helpful? Give feedback.
All reactions