[Usage]: I would like to know how to transfer fps and max_pixels after starting a qwen2vl-7b service using vllm?

[hyyuananran]

Your current environment

The output of `python collect_env.py`

How would you like to use vllm

I want to run inference of a [specific model](put link here). I don't know how to integrate it with vllm.

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[DarkLight1337]

You should sample the video frames outside of vLLM.

You can set max_pixels via the mm_processor_kwargs key (which is passed alongside multi_modal_data) in offline inference. This isn't supported in online inference though, so if you're using vllm serve then you have to pass it at startup time.

[hyyuananran]

I passed the max_pixels parameter through mm_processor_kwargs, but encountered an error:
api_server.py error argument --mm_processor_kwargs invalid loads value max_pixels:798
command：
python -m vllm.entrypoints.openai.api_server --host 0.0.0.0 --port 8088 --model /app/qwen2vl-7b --tensor-parrallel 1 --gpu-memory-utilization 0.95 --served-model-name qwen2vl-7b --mm_processor_kwargs {"max_pixels":798} --trust-remote-code

[DarkLight1337]

You need to pass it as a JSON string. You can enclose it with single quotes, i.e. '{"max_pixels":798}'