ECCV-2022 Contrastive Deep Supervision
OpenAI-2022 Robust Speech Recognition via Large-Scale Weak Supervision
TPAMI-2020 ProtTrans：Towards Cracking the Language of Life’s Code Through Self-Supervised Learning
Nature Machine Intelligence-2022 Learning functional properties of proteins with language models
ICLR-2021 Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning
JMLR-2022 Switch Transformers：Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
NIPS-2019 Unified Language Model Pre-training for Natural Language Understanding and Generation
ICLR-2022 OntoProtein：Protein Pretraining With Gene Ontology Embedding
Nature Biotechnology-2022 Single-sequence protein structure prediction using a language model and deep learning
KDD-2021 Modeling Protein Using Large-scale Pretrain Language Model
Archive: 2022/11
Total 266 articles