We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 8280d26 commit 6fa7ae3Copy full SHA for 6fa7ae3
README.md
@@ -110,12 +110,11 @@ In this case, please install vLLM first. You can do so by running
110
container with the following commands:
111
112
```
113
-TEMP_TRITON_VLLM_DIR=/tmp/backends/vllm_backend
+TEMP_TRITON_VLLM_DIR=/tmp/vllm_backend
114
mkdir -p /opt/tritonserver/backends/vllm $TEMP_TRITON_VLLM_DIR
115
git clone https://github.com/triton-inference-server/vllm_backend.git $TEMP_TRITON_VLLM_DIR
116
cp -r $TEMP_TRITON_VLLM_DIR/src/* /opt/tritonserver/backends/vllm
117
rm -rf $TEMP_TRITON_VLLM_DIR
118
-rm -d /tmp/backends
119
120
121
## Using the vLLM Backend
0 commit comments