[llama runner] add xnnpack backend

[mcr229]

Adding support for OSS Dynamically Quantized Linear via XNNPACK for llama models.

This now works for cmake on non-mac devices. Additionally, we modified the test-llama-runner-linux work flow and script to test exporting and running via XNNPACK DQ Linear

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/2585

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 10 New Failures, 1 Unrelated Failure

As of commit 1b99d29 with merge base 24fe99c ():

NEW FAILURES - The following jobs have failed:

• pull / test-llama-runner-linux (fp16, buck2) / linux-job (gh)
  RuntimeError: Failed to compile /tmp/tmp928reobs/data.json to /tmp/tmp928reobs/data.pte. Set ET_EXIR_SAVE_FLATC_INPUTS_ON_FAILURE=1 to save input files on failure.
• pull / test-llama-runner-linux (fp16, cmake) / linux-job (gh)
  RuntimeError: Failed to compile /tmp/tmpebjacxkn/data.json to /tmp/tmpebjacxkn/data.pte. Set ET_EXIR_SAVE_FLATC_INPUTS_ON_FAILURE=1 to save input files on failure.
• pull / test-llama-runner-linux (fp32, buck2) / linux-job (gh)
  RuntimeError: Command docker exec -t 5c348f0dd2c286f64891b9e8bdc30efce1f49bf51cc9b3c4913cb11af1da53af /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, cmake) / linux-job (gh)
  RuntimeError: Failed to compile /tmp/tmplm2wh5io/data.json to /tmp/tmplm2wh5io/data.pte. Set ET_EXIR_SAVE_FLATC_INPUTS_ON_FAILURE=1 to save input files on failure.
• pull / test-models-linux (cmake, ic3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  Delegation fp32 error
• pull / test-models-linux (cmake, mv2, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  Delegation fp32 error
• pull / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  Delegation fp32 error
• pull / test-models-linux (cmake, resnet18, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  Delegation fp32 error
• pull / test-models-linux (cmake, vit, xnnpack-delegation, linux.2xlarge, 90) / linux-job (gh)
  Delegation fp32 error
• pull / unittest / linux (buck2) / linux-job (gh)
  RuntimeError: Command docker exec -t babc89c2be6070036ed2eadf5a6aad5008e814b191ed8f79f70f4263c9805517 /exec failed with exit code 1

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / unittest / macos (buck2) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

@mcr229 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[facebook-github-bot]

@mcr229 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[facebook-github-bot]

@mcr229 merged this pull request in 725c590.