You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
报错信息为
litellm.exceptions.BadRequestError: litellm.BadRequestError: XinferenceException - Error code: 400 - {'detail': 'Invalid input. Please specify the prompt.'}
ERROR: Failed to get supported params: argument of type 'NoneType' is not iterable
DCJsenior
changed the title
在crewai上运行xinference部署的qwen2.5模型报错
litellm.exceptions.BadRequestError: litellm.BadRequestError: XinferenceException - Error code: 400 - {'detail': 'Invalid input. Please specify the prompt.'}在crewai上运行xinference部署的qwen2.5模型报错
Dec 31, 2024
System Info / 系統信息
python=3.10
windows操作系统
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
Version info / 版本信息
crewai == 0.86.0
xinference == 1.0.1
The command used to start Xinference / 用以启动 xinference 的命令
使用docker启动
Reproduction / 复现过程
运行crewai的quickstart,https://docs.crewai.com/quickstart,修改llm的配置为xinference上的qwen2.5-14b-instruct,报错
llm = LLM( model="xinference/qwen2.5-14b-instruct", temperature=0.2, base_url="http://124.70.213.108:7009/v1", api_key="EMPTY" )
Expected behavior / 期待表现
应该正常运行
The text was updated successfully, but these errors were encountered: