feat(moe+ssm): expert-LoRA GEMM stack and hybrid-recompute guard on the d12f6c8c base - #1

feat(moe+ssm): expert-LoRA GEMM stack and hybrid-recompute guard on the d12f6c8c base#1

taufeeque9 wants to merge 9 commits into

farai/mainAlignmentResearch/Megatron-LM:farai/mainfrom

tf-at/moe-lora-stack-on-d12f6c8cAlignmentResearch/Megatron-LM:tf-at/moe-lora-stack-on-d12f6c8cCopy head branch name to clipboard