Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: add macos installation script #10658

Closed
1 task done
youkaichao opened this issue Nov 26, 2024 · 5 comments · Fixed by #11696
Closed
1 task done

[Feature]: add macos installation script #10658

youkaichao opened this issue Nov 26, 2024 · 5 comments · Fixed by #11696
Labels

Comments

@youkaichao
Copy link
Member

🚀 The feature, motivation and pitch

After #9228 , we should be able to install a developing version of vllm locally using macos.

Mainly need to clean up the dockerfile and figure out a way to install it.

Alternatives

No response

Additional context

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@youkaichao
Copy link
Member Author

@mgoin mgoin added the good first issue Good for newcomers label Nov 26, 2024
@iamrajhans
Copy link

@mgoin can i take this issue?

@iamrajhans
Copy link

iamrajhans commented Dec 4, 2024

hi @youkaichao @mgoin , i have build the image successfully using the same Dockerfile.arm without any changes and for running need to change the command - docker run -it -p 8000:8000 --rm vllm-cpu-env
Screenshot 2024-12-04 at 11 43 33 AM

Testing done on - Macbook Pro M1 machine

@youkaichao
Copy link
Member Author

@iamrajhans ideally i'd like to make pip install -e . work for macos, not just through docker.

@rahulmisal27
Copy link

@mgoin @youkaichao I am getting below error while building the container image on my mac m3 machine.

ERROR: Could not open requirements file: [Errno 13] Permission denied: 'requirements-build.txt' building at STEP "RUN --mount=type=cache,target=/root/.cache/pip --mount=type=bind,src=requirements-build.txt,target=requirements-build.txt pip install --upgrade pip && pip install -r requirements-build.txt": while running runtime: exit status 1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants