Update the installation of vllm in readme
#13
by
unsubscribe
- opened
README.md
CHANGED
|
@@ -204,15 +204,10 @@ for chunk in stream:
|
|
| 204 |
|
| 205 |
#### vLLM inference
|
| 206 |
|
| 207 |
-
|
| 208 |
|
| 209 |
```python
|
| 210 |
-
|
| 211 |
-
# and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
|
| 212 |
-
cd vllm
|
| 213 |
-
python use_existing_torch.py
|
| 214 |
-
pip install -r requirements-build.txt
|
| 215 |
-
pip install -e . --no-build-isolatio
|
| 216 |
```
|
| 217 |
|
| 218 |
inference code:
|
|
@@ -407,14 +402,10 @@ for chunk in stream:
|
|
| 407 |
|
| 408 |
#### vLLM inference
|
| 409 |
|
| 410 |
-
|
|
|
|
| 411 |
```python
|
| 412 |
-
|
| 413 |
-
# and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
|
| 414 |
-
cd vllm
|
| 415 |
-
python use_existing_torch.py
|
| 416 |
-
pip install -r requirements-build.txt
|
| 417 |
-
pip install -e . --no-build-isolatio
|
| 418 |
```
|
| 419 |
|
| 420 |
inference code
|
|
@@ -642,15 +633,10 @@ for chunk in stream:
|
|
| 642 |
|
| 643 |
##### vLLM 推理
|
| 644 |
|
| 645 |
-
|
| 646 |
|
| 647 |
-
```
|
| 648 |
-
|
| 649 |
-
# and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
|
| 650 |
-
cd vllm
|
| 651 |
-
python use_existing_torch.py
|
| 652 |
-
pip install -r requirements-build.txt
|
| 653 |
-
pip install -e . --no-build-isolatio
|
| 654 |
```
|
| 655 |
|
| 656 |
推理代码
|
|
@@ -844,15 +830,10 @@ for chunk in stream:
|
|
| 844 |
|
| 845 |
##### vLLM 推理
|
| 846 |
|
| 847 |
-
|
| 848 |
|
| 849 |
-
```
|
| 850 |
-
|
| 851 |
-
# and then follow https://docs.vllm.ai/en/latest/getting_started/installation/gpu/index.html#build-wheel-from-source to install
|
| 852 |
-
cd vllm
|
| 853 |
-
python use_existing_torch.py
|
| 854 |
-
pip install -r requirements-build.txt
|
| 855 |
-
pip install -e . --no-build-isolatio
|
| 856 |
```
|
| 857 |
|
| 858 |
推理代码
|
|
|
|
| 204 |
|
| 205 |
#### vLLM inference
|
| 206 |
|
| 207 |
+
Refer to [installation](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) to install the latest code of vllm
|
| 208 |
|
| 209 |
```python
|
| 210 |
+
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 211 |
```
|
| 212 |
|
| 213 |
inference code:
|
|
|
|
| 402 |
|
| 403 |
#### vLLM inference
|
| 404 |
|
| 405 |
+
Refer to [installation](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) to install the latest code of vllm
|
| 406 |
+
|
| 407 |
```python
|
| 408 |
+
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 409 |
```
|
| 410 |
|
| 411 |
inference code
|
|
|
|
| 633 |
|
| 634 |
##### vLLM 推理
|
| 635 |
|
| 636 |
+
参考[文档](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) 安装 vllm 最新代码
|
| 637 |
|
| 638 |
+
```bash
|
| 639 |
+
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 640 |
```
|
| 641 |
|
| 642 |
推理代码
|
|
|
|
| 830 |
|
| 831 |
##### vLLM 推理
|
| 832 |
|
| 833 |
+
参考[文档](https://docs.vllm.ai/en/latest/getting_started/installation/index.html) 安装 vllm 最新代码
|
| 834 |
|
| 835 |
+
```bash
|
| 836 |
+
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 837 |
```
|
| 838 |
|
| 839 |
推理代码
|