OpenAI-2022 Robust Speech Recognition via Large-Scale Weak Supervision

Nov 19 PaperNote cs.Speech, cs.Transformer Comments Word Count: 1.8k(words) Read Count: 6(minutes)

TPAMI-2020 ProtTrans：Towards Cracking the Language of Life’s Code Through Self-Supervised Learning

Nov 17 PaperNote BI, cs.Transformer Comments Word Count: 1.4k(words) Read Count: 5(minutes)

Nature Machine Intelligence-2022 Learning functional properties of proteins with language models

Nov 16 PaperNote BI Comments Word Count: 4.1k(words) Read Count: 14(minutes)

ICLR-2021 Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning

Nov 13 PaperNote CL, cs.ContraLern, cs.Transformer Comments Word Count: 720(words) Read Count: 2(minutes)

JMLR-2022 Switch Transformers：Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

Nov 12 PaperNote CL, cs.Transformer Comments Word Count: 2.7k(words) Read Count: 9(minutes)

NIPS-2019 Unified Language Model Pre-training for Natural Language Understanding and Generation

Nov 12 PaperNote CL, cs.Transformer Comments Word Count: 552(words) Read Count: 2(minutes)

ICLR-2022 OntoProtein：Protein Pretraining With Gene Ontology Embedding

Nov 9 PaperNote BI, cs.Transformer Comments Word Count: 1.1k(words) Read Count: 3(minutes)

Nature Biotechnology-2022 Single-sequence protein structure prediction using a language model and deep learning

Nov 9 PaperNote BI, cs.Transformer Comments Word Count: 712(words) Read Count: 2(minutes)

KDD-2021 Modeling Protein Using Large-scale Pretrain Language Model

Nov 8 PaperNote BI, cs.Transformer Comments Word Count: 541(words) Read Count: 1(minutes)

NIPS-2022 Chain of Thought Prompting Elicits Reasoning in Large Language Models

Oct 29 PaperNote CL, cs.CoT Comments Word Count: 617(words) Read Count: 2(minutes)