Skip to content

fix(rl): reduce Megatron peak memory in selective_log_softmax, causal mask, and discarded logits - #322

Open
Wings-Of-Disaster wants to merge 3 commits into
modelscope:mainfrom
Wings-Of-Disaster:fix/megatron-eval-path
Open

fix(rl): reduce Megatron peak memory in selective_log_softmax, causal mask, and discarded logits#322
Wings-Of-Disaster wants to merge 3 commits into
modelscope:mainfrom
Wings-Of-Disaster:fix/megatron-eval-path

fix(megatron): do not retain and cat logits that are discarded

94df495
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
lint
succeeded Oct 16, 2026 in 47s