Skip to content

Commit 169178b

Browse files
authored
Preparing for release. (#2540)
* Preparing for release. * Upgrade version in docs.
1 parent 7e2d188 commit 169178b

File tree

7 files changed

+8
-8
lines changed

7 files changed

+8
-8
lines changed

Cargo.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ default-members = [
2020
resolver = "2"
2121

2222
[workspace.package]
23-
version = "2.2.1-dev0"
23+
version = "2.3.1-dev0"
2424
edition = "2021"
2525
authors = ["Olivier Dehaene"]
2626
homepage = "https://github.com/huggingface/text-generation-inference"

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -83,7 +83,7 @@ model=HuggingFaceH4/zephyr-7b-beta
8383
volume=$PWD/data
8484

8585
docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data \
86-
ghcr.io/huggingface/text-generation-inference:2.2.0 --model-id $model
86+
ghcr.io/huggingface/text-generation-inference:2.3.0 --model-id $model
8787
```
8888

8989
And then you can make requests like

docs/openapi.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@
1010
"name": "Apache 2.0",
1111
"url": "https://www.apache.org/licenses/LICENSE-2.0"
1212
},
13-
"version": "2.2.1-dev0"
13+
"version": "2.3.1-dev0"
1414
},
1515
"paths": {
1616
"/": {

docs/source/installation_amd.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ volume=$PWD/data # share a volume with the Docker container to avoid downloading
1111
docker run --rm -it --cap-add=SYS_PTRACE --security-opt seccomp=unconfined \
1212
--device=/dev/kfd --device=/dev/dri --group-add video \
1313
--ipc=host --shm-size 256g --net host -v $volume:/data \
14-
ghcr.io/huggingface/text-generation-inference:2.2.0-rocm \
14+
ghcr.io/huggingface/text-generation-inference:2.3.0-rocm \
1515
--model-id $model
1616
```
1717

docs/source/installation_intel.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ volume=$PWD/data # share a volume with the Docker container to avoid downloading
1212
docker run --rm --privileged --cap-add=sys_nice \
1313
--device=/dev/dri \
1414
--ipc=host --shm-size 1g --net host -v $volume:/data \
15-
ghcr.io/huggingface/text-generation-inference:2.2.0-intel-xpu \
15+
ghcr.io/huggingface/text-generation-inference:2.3.0-intel-xpu \
1616
--model-id $model --cuda-graphs 0
1717
```
1818

@@ -29,7 +29,7 @@ volume=$PWD/data # share a volume with the Docker container to avoid downloading
2929
docker run --rm --privileged --cap-add=sys_nice \
3030
--device=/dev/dri \
3131
--ipc=host --shm-size 1g --net host -v $volume:/data \
32-
ghcr.io/huggingface/text-generation-inference:2.2.0-intel-cpu \
32+
ghcr.io/huggingface/text-generation-inference:2.3.0-intel-cpu \
3333
--model-id $model --cuda-graphs 0
3434
```
3535

docs/source/installation_nvidia.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ model=teknium/OpenHermes-2.5-Mistral-7B
1111
volume=$PWD/data # share a volume with the Docker container to avoid downloading weights every run
1212

1313
docker run --gpus all --shm-size 64g -p 8080:80 -v $volume:/data \
14-
ghcr.io/huggingface/text-generation-inference:2.2.0 \
14+
ghcr.io/huggingface/text-generation-inference:2.3.0 \
1515
--model-id $model
1616
```
1717

docs/source/quicktour.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ model=teknium/OpenHermes-2.5-Mistral-7B
1111
volume=$PWD/data # share a volume with the Docker container to avoid downloading weights every run
1212

1313
docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data \
14-
ghcr.io/huggingface/text-generation-inference:2.2.0 \
14+
ghcr.io/huggingface/text-generation-inference:2.3.0 \
1515
--model-id $model
1616
```
1717

0 commit comments

Comments
 (0)