Avoid curl fails due to server startup time

[mikekgfb]

Add sleep after server startup to make sure server ready prior to client request via curl

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchchat/1418

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit d05f793 with merge base 7b86dc3 ():

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / test-cpu-aoti (aarch64, stories15M) (gh) (trunk failure)
  Process completed with exit code 1.
• pull / test-cpu-aoti (x86_64, stories15M) (gh) (trunk failure)
  Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[Jack-Khuu]

I like sleep

[mikekgfb]

I like sleep

Yep, gives the service enough time to come up. =>

https://github.com/pytorch/torchchat/actions/runs/12301358926/job/34331782890?pr=1418

+ server_pid=383
  + sleep 90
  + python3 torchchat.py server stories15M
  NumExpr defaulting to 16 threads.
  PyTorch version 2.6.0.dev20241028+cu121 available.
  Using device=cuda NVIDIA A10G
  Loading model...
  Time to load model: 0.21 seconds
  -----------------------------------------------------------
   * Serving Flask app 'torchchat.usages.server'
   * Debug mode: off
  WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
   * Running on http://127.0.0.1:5000
  Press CTRL+C to quit
  + curl http://127.0.0.1:5000/v1/chat/completions -H 'Content-Type: application/json' -d '{
      "model": "stories15M",
      "stream": "true",
      "max_tokens": 200,
      "messages": [
        {
          "role": "system",
          "content": "You are a helpful assistant."
        },
        {
          "role": "user",
          "content": "Hello!"
        }
      ]
    }'
   === Completion Request ===
  [3127](https://github.com/pytorch/torchchat/actions/runs/12301358926/job/34331782890?pr=1418#step:14:3139).0.0.1 - - [12/Dec/2024 17:23:24] "POST /v1/chat/completions HTTP/1.1" 200 -
  data:{"id": "chatcmpl-945c812d-3491-48b4-90c6-3eb9c0996e57", "choices": [{"delta": {"role": "assistant", "content": "3"}}], "created": 1734024204, "model": "stories15M", "system_fingerprint": "cuda_torch.bfloat16", "object": "chat.completion.chunk"}