Tag: OS Total 5 articles All cs.GNN other logic pytorch cs.Meta cs.Transformer cs.Speech BI cs.diffusion CL cs.CoT cs.GAN CV cs.Multimodal cs.ContraLern cs.Object SE cs.MoE cs.Video IR cs.Recom OS 2022-06-17 SC-2020 ZeRO：Memory Optimizations Toward Training Trillion Parameter Models 2022-06-04 GTC-2020 Megatron-LM：Training Multi-Billion Parameter Language Models Using Model Parallelism 2022-06-03 NIPS-2019 GPipe：Efficient Training of Giant Neural Networks using Pipeline Parallelism 2022-05-10 Google-2022 Pathways：Asynchronous Distributed Dataflow for ML 2022-04-22 OSDI-2014 Scaling Distributed Machine Learning with the Parameter Server
2022-06-04 GTC-2020 Megatron-LM：Training Multi-Billion Parameter Language Models Using Model Parallelism
