bioRxiv-2023 When Geometric Deep Learning Meets Pretrained Protein Language Models

Jan 9 PaperNote BI, cs.GNN, cs.Transformer Comments Word Count: 916(words) Read Count: 3(minutes)

OpenAI-2022 Training language models to follow instructions with human feedback

Jan 7 PaperNote CL, cs.Transformer Comments Word Count: 1.3k(words) Read Count: 4(minutes)

NIPS-2022 Transformer Memory as a Differentiable Search Index

Dec 19 PaperNote IR Comments Word Count: 772(words) Read Count: 2(minutes)

NIPS-2022 A Neural Corpus Indexer for Document Retrieval

Dec 19 PaperNote IR Comments Word Count: 1.4k(words) Read Count: 5(minutes)

NAACL-2022 MoEBERT：from BERT to Mixture-of-Experts via Importance-Guided Adaptation

Dec 17 PaperNote CL, cs.MoE, cs.Transformer Comments Word Count: 829(words) Read Count: 3(minutes)

NIPS-2021 VLMo：Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts

Dec 14 PaperNote CL, CV, cs.ContraLern, cs.Multimodal, cs.Transformer Comments Word Count: 466(words) Read Count: 1(minutes)

NIPS-2021 Align before Fuse：Vision and Language Representation Learning with Momentum Distillation

Dec 12 PaperNote CL, CV, cs.ContraLern, cs.Multimodal, cs.Transformer Comments Word Count: 1.2k(words) Read Count: 4(minutes)

DNA Replication and Repair

Dec 9 MIT-molecular biology Comments Word Count: 709(words) Read Count: 2(minutes)

Bioinformatics-2021 DNABERT：pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome

Dec 9 PaperNote BI, cs.Transformer Comments Word Count: 1.2k(words) Read Count: 4(minutes)

ECCV-2022 Contrastive Deep Supervision

Nov 22 PaperNote CV, cs.ContraLern Comments Word Count: 1.2k(words) Read Count: 4(minutes)