[Serve] multiple submodels serve #337

Job	Run time
flagscale-report-clean / clean-report	12s
megatron-report-clean / clean-report	12s
megatron-distributed / unit-test	1s
megatron-dist_checkpointing / unit-test	1s
megatron-data / unit-test	1s
megatron-root / unit-test	1s
megatron-export / unit-test	1s
megatron-fusions / unit-test	1s
megatron-inference / unit-test	1s
megatron-models / unit-test	1s
megatron-pipeline_parallel / unit-test	1s
megatron-ssm / unit-test	1s
megatron-tensor_parallel / unit-test	1s
megatron-transformer / unit-test	1s
megatron-transformer/moe / unit-test	1s
flagscale-runner / unit-test	1s
flagscale-root / unit-test	1s
train-${{ matrix.model }}	1s
hetero_train-${{ matrix.model }}	1s
flagscale-coverage-test	1s
megatron-coverage-test	1s
all-tests	1s
	44s

Provide feedback