can use vllm deploy this model？
#8
by
tianyer - opened
which vllm version can deploy this model? thanks.
tianyer changed discussion title from
can use vllm deplot this model？
to can use vllm deploy this model？
I deploy it with vllm-v0.9.1，and it works
Here is the startup command