Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add vLLM support #75

Open
YangWang92 opened this issue Oct 20, 2024 · 2 comments
Open

Add vLLM support #75

YangWang92 opened this issue Oct 20, 2024 · 2 comments
Assignees
@YangWang92
Labels
inference inference related questions

Comments

@YangWang92
Copy link
Contributor

Add vLLM support
@YangWang92 YangWang92 self-assigned this Oct 20, 2024
@YangWang92 YangWang92 added the inference inference related questions label Oct 20, 2024
@Se-Hun
Copy link

Se-Hun commented Oct 31, 2024

How's the task going?

@YangWang92
Copy link
Contributor Author

How's the task going?

I just started and have opened an issue in the vllm community. I'm also discussing it in their Slack channel. Are you interested in joining?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@YangWang92 YangWang92

Labels
inference inference related questions
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@YangWang92 @Se-Hun