feat: Qwen2

[OlivierDehaene]

See #1584

[OlivierDehaene]

Kudos @Jason-CKY!
I just added the speculative head for medusa support and changed the integration test to use a smaller model.

[paulcx]

@OlivierDehaene errors exsited in fastapi docs front page (sha-e6bb3ff)

Errors
Hide
 
Resolver error at paths./v1/chat/completions.post.requestBody.content.application/json.schema.properties.tool_choice.allOf.0.$ref
Could not resolve reference: Could not resolve pointer: /components/schemas/ToolType does not exist in document
Resolver error at paths./v1/chat/completions.post.requestBody.content.application/json.schema.properties.tools.items.$ref
Could not resolve reference: Could not resolve pointer: /components/schemas/Tool does not exist in document
Resolver error at paths./v1/chat/completions.post.requestBody.content.application/json.schema.properties.messages.items.properties.tool_calls.allOf.0.$ref
Could not resolve reference: Could not resolve pointer: /components/schemas/ToolCall does not exist in document
Resolver error at paths./v1/chat/completions.post.responses.200.content.application/json.schema.properties.choices.items.properties.delta.properties.tool_calls.allOf.0.$ref
Could not resolve reference: Could not resolve pointer: /components/schemas/DeltaToolCall does not exist in document
Resolver error at paths./v1/chat/completions.post.requestBody.content.application/json.schema.properties.messages.items.properties.tool_calls.$ref
Could not resolve reference: Could not resolve pointer: /components/schemas/ToolCall does not exist in document
Resolver error at paths./v1/chat/completions.post.requestBody.content.application/json.schema.properties.tool_choice.$ref
Could not resolve reference: Could not resolve pointer: /components/schemas/ToolType does not exist in document
Resolver error at paths./v1/chat/completions.post.responses.200.content.application/json.schema.properties.choices.items.properties.delta.properties.tool_calls.$ref
Could not resolve reference: Could not resolve pointer: /components/schemas/DeltaToolCall does not exist in document

I also found that the results of model reasoning are completely garbled, as if there are some problems. The same model uses vllm reasoning to answer correctly.

[OlivierDehaene]

I'm sorry I don't understand what you are talking about.

[paulcx]

The errors I pasted above is from web page of TGI api docs. I guess it is related to openapi schema?