Deployment examples

Here are a list of ways you can deploy chat-ui

Run locally

git clone https://github.com/huggingface/chat-ui.git
cd chat-ui && npm i
npm run dev

Run as a docker image

There are two docker images. Use chat-ui if you have an external mongoDB you would like to use, and use chat-ui-db if you'd like an image with everything included.

1. Create a .env.local file with your config options
2. Pass your .env.local either via the DOTENV_LOCAL env variable or via a bind mount:

DOTENV_LOCAL=$(<.env.local)  docker run  -e DOTENV_LOCAL chat-ui-db

or

docker run --mount type=bind,source="$(pwd)/.env.local",target=/app/.env.local chat-ui-db

You can also configure env variables directly without using a .env.local file:

docker run  -e MONGODB_URL=mongodb://localhost:27017 chat-ui-db

Kubernetes

Warning

This may change in ways that break your deployments as we improve HuggingChat and make the chart more stable.

This is what we use in production for HuggingChat. See chart folder.

Unraid

Coming soon !

Docker compose

With a mongo container

Coming soon !

With a text-generation-inference container

Coming soon !

With llama.cpp

Coming soon !