Weiyun1025 commited on
Commit
3095d1a
·
verified ·
1 Parent(s): 4cd1983

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -1411,7 +1411,7 @@ print(sess.response.text)
1411
  LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
1412
 
1413
  ```shell
1414
- lmdeploy serve api_server OpenGVLab/InternVL3_5-8B --server-port 23333 --tp 1
1415
  ```
1416
 
1417
  To use the OpenAI-style interface, you need to install OpenAI:
 
1411
  LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
1412
 
1413
  ```shell
1414
+ lmdeploy serve api_server OpenGVLab/InternVL3_5-8B --server-port 23333 --tp 1 --backend pytorch
1415
  ```
1416
 
1417
  To use the OpenAI-style interface, you need to install OpenAI: