TPAMI-2020 ProtTrans：Towards Cracking the Language of Life’s Code Through Self-Supervised Learning

Nov 17 PaperNote BI Comments Word Count: 1.4k(words) Read Count: 5(minutes)

Nature Machine Intelligence-2022 Learning functional properties of proteins with language models

Nov 16 PaperNote BI Comments Word Count: 4.1k(words) Read Count: 14(minutes)

ICLR-2021 Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning

Nov 13 PaperNote CL Comments Word Count: 720(words) Read Count: 2(minutes)

JMLR-2022 Switch Transformers：Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

Nov 12 PaperNote CL Comments Word Count: 2.7k(words) Read Count: 9(minutes)

NIPS-2019 Unified Language Model Pre-training for Natural Language Understanding and Generation

Nov 12 PaperNote CL Comments Word Count: 552(words) Read Count: 2(minutes)

ICLR-2022 OntoProtein：Protein Pretraining With Gene Ontology Embedding

Nov 9 PaperNote BI Comments Word Count: 1.1k(words) Read Count: 3(minutes)

Nature Biotechnology-2022 Single-sequence protein structure prediction using a language model and deep learning

Nov 9 PaperNote BI Comments Word Count: 712(words) Read Count: 2(minutes)

KDD-2021 Modeling Protein Using Large-scale Pretrain Language Model

Nov 8 PaperNote BI Comments Word Count: 541(words) Read Count: 1(minutes)

NIPS-2022 Chain of Thought Prompting Elicits Reasoning in Large Language Models

Oct 29 PaperNote CL Comments Word Count: 617(words) Read Count: 2(minutes)

ICSE-2022 On the Evaluation of Neural Code Summarization

Oct 26 PaperNote CL, SE Comments Word Count: 859(words) Read Count: 3(minutes)