bioRxiv-2022 Masked inverse folding with sequence transfer for protein representation learning

Jan 18 PaperNote BI, cs.GNN, cs.Transformer Comments Word Count: 1k(words) Read Count: 3(minutes)

bioRxiv-2021 Toward More General Embeddings for Protein Design：Harnessing Joint Representations of Sequence and Structure

Jan 17 PaperNote BI, cs.GNN, cs.Transformer Comments Word Count: 767(words) Read Count: 3(minutes)

NIPS-2022 Image as a Foreign Language：BEiT Pretraining for All Vision and Vision-Language Tasks

Jan 15 PaperNote CL, CV, cs.ContraLern, cs.Multimodal Comments Word Count: 433(words) Read Count: 1(minutes)

NIPS-2022 CoCa：Contrastive Captioners are Image-Text Foundation Models

Jan 15 PaperNote CL, CV, cs.ContraLern, cs.Multimodal Comments Word Count: 165(words) Read Count: 1(minutes)

ICML-2022 BLIP：Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

Jan 14 PaperNote CL, CV, cs.Multimodal Comments Word Count: 497(words) Read Count: 1(minutes)

bioRxiv-2023 When Geometric Deep Learning Meets Pretrained Protein Language Models

Jan 9 PaperNote BI, cs.GNN, cs.Transformer Comments Word Count: 916(words) Read Count: 3(minutes)

OpenAI-2022 Training language models to follow instructions with human feedback

Jan 7 PaperNote CL, cs.Transformer Comments Word Count: 1.3k(words) Read Count: 4(minutes)

NIPS-2022 Transformer Memory as a Differentiable Search Index

Dec 19 PaperNote IR Comments Word Count: 772(words) Read Count: 2(minutes)

NIPS-2022 A Neural Corpus Indexer for Document Retrieval

Dec 19 PaperNote IR Comments Word Count: 1.4k(words) Read Count: 5(minutes)

NAACL-2022 MoEBERT：from BERT to Mixture-of-Experts via Importance-Guided Adaptation

Dec 17 PaperNote CL, cs.MoE, cs.Transformer Comments Word Count: 829(words) Read Count: 3(minutes)