[SYCL] add concat through dim 1/2

[airMeng]

• I have read the contributing guidelines
• Self-reported review complexity:
  • Low
  • Medium
  • High

[airMeng]

@characharm can you try deepseek on this branch? Thank you in advance, your support is our motivation

[airMeng]

@OuadiElfarouki, I'm wondering who I should tag for PR reviews at Codeplay. Could you or someone else represent Codeplay for the following PRs? For any Intel-related issues, feel free to tag me.

[NeoZhangJianyu]

I test UT successfully.
And verify DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M.gguf on Arc770 is passed.

[OuadiElfarouki]

@airMeng Thanks for the tag. You can either reach out to @joeatodd (Team PO at Codeplay), or @Alcpz or myself.

[OuadiElfarouki]

LGTM Thanks!

[characharm]

I test UT successfully. And verify DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M.gguf on Arc770 is passed.

Could you please check this model: DeepSeek-Coder-V2-Lite-Instruct-Q6_K? link I have tried several times, but the computer completely froze every time after loading the model into memory. tested on this build b3398

[airMeng]

I test UT successfully. And verify DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M.gguf on Arc770 is passed.

Could you please check this model: DeepSeek-Coder-V2-Lite-Instruct-Q6_K? link I have tried several times, but the computer completely froze every time after loading the model into memory. tested on this build b3398

seems the model file itself is 14.1GB, how much vram your GPU has?

[characharm]

I test UT successfully. And verify DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M.gguf on Arc770 is passed.

Could you please check this model: DeepSeek-Coder-V2-Lite-Instruct-Q6_K? link I have tried several times, but the computer completely froze every time after loading the model into memory. tested on this build b3398

seems the model file itself is 14.1GB, how much vram your GPU has?

16gb, but other models with the same or even slightly larger file size work fine

[characharm]

b3408 , now it shuts down at this,tried with smaller quants, with the same result