[Serve] support multiple models #285

Job	Run time
flagscale-runner / unit-test	1m 6s
megatron-data / unit-test	1m 19s
megatron-root / unit-test	1m 24s
flagscale-root / unit-test	59s
megatron-dist_checkpointing / unit-test	44s
megatron-distributed / unit-test	1m 36s
megatron-fusions / unit-test	54s
megatron-inference / unit-test	1m 51s
megatron-models / unit-test	1m 50s
megatron-pipeline_parallel / unit-test	1m 24s
megatron-tensor_parallel / unit-test	2m 16s
megatron-transformer / unit-test	1m 29s
megatron-transformer/moe / unit-test	13m 44s
train-mixtral / functional-test	30m 36s
train-aquila / functional-test	18m 25s
hetero_train-aquila / functional-test	28m 1s
megatron-coverage-test / test-coverage	29s
flagscale-coverage-test / test-coverage	27s
all-tests	1s
	1h 48m 35s

Provide feedback