Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

litellm.exceptions.BadRequestError: litellm.BadRequestError: XinferenceException - Error code: 400 - {'detail': 'Invalid input. Please specify the prompt.'}在crewai上运行xinference部署的qwen2.5模型报错 #2722

Open
1 of 3 tasks
DCJsenior opened this issue Dec 30, 2024 · 1 comment
Milestone

Comments

@DCJsenior
Copy link

System Info / 系統信息

python=3.10
windows操作系统

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?

  • docker / docker
  • pip install / 通过 pip install 安装
  • installation from source / 从源码安装

Version info / 版本信息

crewai == 0.86.0
xinference == 1.0.1

The command used to start Xinference / 用以启动 xinference 的命令

使用docker启动

Reproduction / 复现过程

运行crewai的quickstart,https://docs.crewai.com/quickstart,修改llm的配置为xinference上的qwen2.5-14b-instruct,报错

llm = LLM( model="xinference/qwen2.5-14b-instruct", temperature=0.2, base_url="http://124.70.213.108:7009/v1", api_key="EMPTY" )

image

Expected behavior / 期待表现

应该正常运行

@XprobeBot XprobeBot added this to the v1.x milestone Dec 30, 2024
@DCJsenior
Copy link
Author

报错信息为
litellm.exceptions.BadRequestError: litellm.BadRequestError: XinferenceException - Error code: 400 - {'detail': 'Invalid input. Please specify the prompt.'}
ERROR: Failed to get supported params: argument of type 'NoneType' is not iterable

@DCJsenior DCJsenior changed the title 在crewai上运行xinference部署的qwen2.5模型报错 litellm.exceptions.BadRequestError: litellm.BadRequestError: XinferenceException - Error code: 400 - {'detail': 'Invalid input. Please specify the prompt.'}在crewai上运行xinference部署的qwen2.5模型报错 Dec 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants