v3.2.1
What's Changed
- Update to
kernels
0.2.1 by @danieldk in #3084 - Router: add
gemma3-text
model type by @danieldk in #3107 - We need gcc during runtime to enable triton to compile kernels. by @Narsil in #3103
- Release of Gaudi Backend for TGI by @baptistecolle in #3091
- Fixing the docker build. by @Narsil in #3108
- Make the Nix-based Docker container work on non-NixOS by @danieldk in #3109
- xpu 2.6 update by @sywangyi in #3051
- launcher: correctly get the head dimension for VLMs by @danieldk in #3116
- Gaudi: Sync TGI with the latest changes from the TGI-Gaudi fork by @baptistecolle in #3117
- Bug Fix: Sliding Window Attention by @mht-sharma in #3112
- Publish nix docker image. by @Narsil in #3122
- Prepare for patch release. by @Narsil in #3124
- Intel docker. by @Narsil in #3121
Full Changelog: v3.2.0...v3.2.1