Skip to content

v0.3.2
Compare
Choose a tag to compare
@OlivierDehaene OlivierDehaene released this 03 Mar 17:42
· 1301 commits to main since this release
v0.3.2
1c19b09
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Features

  • router: add support for huggingface api-inference
  • server: add logits watermark with "A Watermark for Large Language Models"
  • server: use a fixed transformers commit

Fix

  • launcher: add missing parameters to launcher
  • server: update to hf_transfer==0.1.2 to fix corrupted files issue
Assets 2
Loading