Skip to content

Add Context Parallel (CP) support for RMSNorm#1076

Open
yukiu00 wants to merge 3 commits into
linkedin:mainfrom
yukiu00:feature/context-parallel-rms-norm
Open

Add Context Parallel (CP) support for RMSNorm#1076
yukiu00 wants to merge 3 commits into
linkedin:mainfrom
yukiu00:feature/context-parallel-rms-norm

Fix dW all-reduce to handle multi-dimensional meshes

0e0c5cd
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.