[AutoParallel] Fix fast_rms_norm

[Xing-lil]

Before submitting

• Lint code. If there are lint issues, please format the code first.

# Install and register `pre-commit` in the project folder
pip install pre-commit && pre-commit install

# Process previous code files separately
pre-commit run --file XXXX.py

• Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

Bug fixes

PR changes

Others

Description

Fix fast_rms_norm
The loss curve of llama13b_layer10_sd8 with fast_rms_norm true / false:

[paddle-bot]

Thanks for your contribution!

[liym27]

CI 里有动半 fast_layer_norm的测试吗

[Xing-lil]

CI 里有动半 fast_layer_norm的测试吗

已添加动半llama验证fast_layer_norm的ci监控，感谢！

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 46.93%. Comparing base (7309a5d) to head (9f79de3).
Report is 2 commits behind head on develop.

❌ Your project status has failed because the head coverage (46.93%) is below the target coverage (58.00%). You can increase the head coverage or adjust the target coverage.

Additional details and impacted files

@@           Coverage Diff            @@
##           develop   #10711   +/-   ##
========================================
  Coverage    46.93%   46.93%           
========================================
  Files          800      800           
  Lines       132741   132741           
========================================
  Hits         62304    62304           
  Misses       70437    70437           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[liym27]

LGTM

[ZHUI]

LGTM