[Megatron-LM] Merge the latest Megatron-LM repository #348

Job	Run time
megatron-report-clean / clean-report	12s
flagscale-report-clean / clean-report	12s
megatron-root / unit-test	1m 22s
megatron-data / unit-test	1m 21s
megatron-distributed / unit-test	1m 48s
megatron-dist_checkpointing / unit-test	16m 18s
megatron-export / unit-test	58s
megatron-fusions / unit-test	49s
megatron-inference / unit-test	1m 28s
megatron-models / unit-test	1m 31s
megatron-ssm / unit-test	47s
megatron-tensor_parallel / unit-test	1m 48s
megatron-pipeline_parallel / unit-test	1m 8s
megatron-transformer / unit-test	1m 13s
megatron-transformer/moe / unit-test	11m 16s
flagscale-runner / unit-test	1s
flagscale-root / unit-test	46s
train-${{ matrix.model }}	0s
hetero_train-${{ matrix.model }}	0s
megatron-coverage-test	0s
flagscale-coverage-test	0s
all-tests	0s
	42m 58s

Provide feedback