Update base for Update on "Update pytorch pin to 2024/03/21 nightly"

## Context

Update PyTorch nightly pin to 2024/03/21. Note that as of 2024/03/20 PyTorch version has been bumped to `2.4.0` (from `2.3.0`) and torchvision has been bumped to `0.19.0` (from `0.18.0`).
 
Differential Revision: [D55198673](https://our.internmc.facebook.com/intern/diff/D55198673)

[ghstack-poisoned]

Author: SS-JIA