Skip to content

Commit de8f25b

Browse files
committed
Minor update
1 parent a99d38b commit de8f25b

File tree

2 files changed

+4
-6
lines changed

2 files changed

+4
-6
lines changed

README.md

Lines changed: 3 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -110,11 +110,9 @@ In this case, please install vLLM first. You can do so by running
110110
container with the following commands:
111111

112112
```
113-
TEMP_TRITON_VLLM_DIR=/tmp/vllm_backend
114-
mkdir -p /opt/tritonserver/backends/vllm $TEMP_TRITON_VLLM_DIR
115-
git clone https://github.com/triton-inference-server/vllm_backend.git $TEMP_TRITON_VLLM_DIR
116-
cp -r $TEMP_TRITON_VLLM_DIR/src/* /opt/tritonserver/backends/vllm
117-
rm -rf $TEMP_TRITON_VLLM_DIR
113+
mkdir -p /opt/tritonserver/backends/vllm
114+
git clone https://github.com/triton-inference-server/vllm_backend.git /tmp/vllm_backend
115+
cp -r /tmp/vllm_backend/src/* /opt/tritonserver/backends/vllm
118116
```
119117

120118
## Using the vLLM Backend

src/utils/metrics.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -83,7 +83,7 @@ def _log_counter(self, counter, data: Union[int, float]) -> None:
8383
counter.increment(data)
8484

8585
def log(self, stats: VllmStats) -> None:
86-
"""Logs to triton metrics server every iteration.
86+
"""Report stats to Triton metrics server.
8787
8888
Args:
8989
stats: Created by LLMEngine for use by VllmStatLogger.

0 commit comments

Comments
 (0)