[quant] Use Int8DynActInt4WeightQuantizer in torchao

[jerryzh168]

Stack from ghstack (oldest at bottom):

• -> [quant] Use Int8DynActInt4WeightQuantizer in torchao #2551

Summary:
att

Test Plan:
python3 -m examples.models.llama2.export_llama -c stories110M.pt -p params.json -qmode 8da4w -X -d fp32

Reviewers:

Subscribers:

Tasks:

Tags:

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/2551

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 1 Unrelated Failure

As of commit c061495 with merge base 6bef9e7 ():

NEW FAILURES - The following jobs have failed:

• pull / test-llama-runner-linux (fp16, cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t 511e4fbe35fc0ccfe7107751e7cb429baa343d353f73ebc5c7a014af1309edca /exec failed with exit code 2
• pull / test-llama-runner-linux (fp32, cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t 17154b30dbfd3a0d35ea1a9f583e79c5d9e72adad6a6d221b6a0784e00dd429d /exec failed with exit code 2

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / unittest / macos (buck2) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

@jerryzh168 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[facebook-github-bot]

@jerryzh168 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[facebook-github-bot]

@jerryzh168 merged this pull request in a6aefc0.