Skip to content

[megatron] Fused LM-head log-prob + entropy (avoid full [*, seq, vocab] logit materialization)#1765

Open
dyurk-lila wants to merge 7 commits into
NovaSky-AI:mainfrom
dyurk-lila:feat/fused-linear-cross-entropy
Open

[megatron] Fused LM-head log-prob + entropy (avoid full [*, seq, vocab] logit materialization)#1765
dyurk-lila wants to merge 7 commits into
NovaSky-AI:mainfrom
dyurk-lila:feat/fused-linear-cross-entropy

Apply suggestions from code review

91ce4db
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs