·
3 commits
to release/v1.2.0
since this release
New Features
TensorDict support for EBC and EC
an EBC/EC module can now take in TensorDict as the data input in alternative to KeyedJaggedTensor: #2581 #2596
Customized Embedding Lookup Kernel Support
NVIDIA dynamicemb package depends on an old TorchRec release (r0.7) plus a PR(#2533), refactor TorchRec embedding lookup structures to be easy to plug in a customized emb-lookup kernel: #2887 #2891
Prototype of Dynamic Sharding
Add initial dynamic sharding API and test. This current version supports EBC, TW, and Sharded Tensor. And other variants beyond those configurations (e.g. CW, RW, DTensor etc..): #2852 #2875 #2877 #2863
TorchRec 2D Parallel for EmbeddingCollection
Adding support for EmbeddingCollection modules in 2D parallel. This supports all sharding types that are supported for EC. #2737