Kv Cache as mutable buffer

[JacobSzwejbka]

Summary: Big mish mash of changes to support kv cache as a mutable buffer see this stack D55219107 for the individual reviews

Reviewed By: mergennachin

Differential Revision: D55229223

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/2595

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 1 Unrelated Failure

As of commit c0b7ad3 with merge base ba920e4 ():

NEW FAILURES - The following jobs have failed:

• pull / test-llama-runner-linux (fp16, buck2) / linux-job (gh)
  RuntimeError: Failed to compile /tmp/tmpqleuorlj/data.json to /tmp/tmpqleuorlj/data.pte. Set ET_EXIR_SAVE_FLATC_INPUTS_ON_FAILURE=1 to save input files on failure.
• pull / test-llama-runner-linux (fp16, cmake) / linux-job (gh)
  RuntimeError: Failed to compile /tmp/tmp8qhxce7y/data.json to /tmp/tmp8qhxce7y/data.pte. Set ET_EXIR_SAVE_FLATC_INPUTS_ON_FAILURE=1 to save input files on failure.
• pull / test-llama-runner-linux (fp32, buck2) / linux-job (gh)
  RuntimeError: Failed to compile /tmp/tmppnvx6vnw/data.json to /tmp/tmppnvx6vnw/data.pte. Set ET_EXIR_SAVE_FLATC_INPUTS_ON_FAILURE=1 to save input files on failure.
• pull / test-llama-runner-linux (fp32, cmake) / linux-job (gh)
  RuntimeError: Command docker exec -t 0cc6b4878a56ceb87466ba363813633f5b7a0462f1b79a9d8f3a389653f83574 /exec failed with exit code 1
• pull / unittest / linux (buck2) / linux-job (gh)
  RuntimeError: Command docker exec -t 4dcb0746028ae407f89b4bbac2cedbc1554cb94bda76446c6ea588347ab9af47 /exec failed with exit code 1

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / unittest / macos (buck2) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D55229223

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D55229223

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D55229223

[facebook-github-bot]

This pull request has been merged in 1d934f0.