OpenAI-2022 Training language models to follow instructions with human feedback

Jan 7 PaperNote CL Comments Word Count: 1.3k(words) Read Count: 4(minutes)

NIPS-2022 Transformer Memory as a Differentiable Search Index

Dec 19 PaperNote IR Comments Word Count: 772(words) Read Count: 2(minutes)

NIPS-2022 A Neural Corpus Indexer for Document Retrieval

Dec 19 PaperNote IR Comments Word Count: 1.4k(words) Read Count: 5(minutes)

NAACL-2022 MoEBERT：from BERT to Mixture-of-Experts via Importance-Guided Adaptation

Dec 17 PaperNote CL Comments Word Count: 829(words) Read Count: 3(minutes)

NIPS-2021 VLMo：Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts

Dec 14 PaperNote CL, CV Comments Word Count: 466(words) Read Count: 1(minutes)

NIPS-2021 Align before Fuse：Vision and Language Representation Learning with Momentum Distillation

Dec 12 PaperNote CL, CV Comments Word Count: 1.2k(words) Read Count: 4(minutes)

DNA Replication and Repair

Dec 9 MIT-molecular biology Comments Word Count: 709(words) Read Count: 2(minutes)

Bioinformatics-2021 DNABERT：pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome

Dec 9 PaperNote BI Comments Word Count: 1.2k(words) Read Count: 4(minutes)

ECCV-2022 Contrastive Deep Supervision

Nov 22 PaperNote CV Comments Word Count: 1.2k(words) Read Count: 4(minutes)

OpenAI-2022 Robust Speech Recognition via Large-Scale Weak Supervision

Nov 19 PaperNote CL Comments Word Count: 1.8k(words) Read Count: 6(minutes)