Set member variable to Attention module

[chunit-quic]

• Set and use self.n_heads from args.heads
• Use self.dim from args.dim

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/6376

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures

As of commit 3e99253 with merge base ad0e5e8 ():

NEW FAILURES - The following jobs have failed:

• pull / test-eval_llama-mmlu-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 7de5263cbd92801a291f5e6d01886ec20666999f907be020fdf5e5e012fa434a /exec failed with exit code 127
• pull / test-eval_llama-wikitext-linux / linux-job (gh)
  RuntimeError: Command docker exec -t d2e433a62ae2cac834fddd6ece3359d8ae3b2d8a9751add054e5074488295f86 /exec failed with exit code 127
• pull / test-llama_runner_eager-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 925856b308a338c6dfe45932b0ef19f59151ce0ffd1986fc48b4dba447be9cd2 /exec failed with exit code 127

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

@cccclai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[cccclai]

Looks good to me. I'll trigger more test just in case.

[helunwencser]

let's remove this comment since it is not true anymore. Different models have different configs for these values.

[cccclai]

let me remove in the follow up diff

[facebook-github-bot]

@cccclai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.