NLP / Agents — Paper Notes
LLMs, scientific agents, and language-model tooling
2018
OpenAI
OpenAI-2018 Improving Language Understanding by Generative Pre-Training
2018-11-21 · LLM, NLP
ACL
ACL-2018 Improving Abstraction in Text Summarization
2018-10-23 · NLP
ICLR
ICLR-2019 Graph2Seq：Graph to Sequence Learning with Attention-based Neural Networks
2018-09-28 · NLP, GNN
AAAI
AAAI-2018 Generative Adversarial Network for Abstractive Text Summarization
2018-02-02 · NLP
2019
ACL
ACL-2019 Improving Robustness of Neural Machine Translation with Multi-task Learning
2019-08-01 · LLM, NLP
arXiv
arXiv-2019 RoBERTa：A Robustly Optimized BERT Pretraining Approach
2019-07-26 · LLM, NLP
OpenAI
OpenAI-2019 Language Models are Unsupervised Multitask Learners
2019-07-06 · LLM, NLP
arXiv
arXiv-2019 Unified Language Model Pre-training for Natural Language Understanding and Generation
2019-05-08 · LLM, NLP, transformer
ICML
ICML-2019 Parameter-Efficient Transfer Learning for NLP
2019-02-02 · LLM, NLP
2021
2022
arXiv
arXiv-2022 Holistic Evaluation of Language Models
2022-11-09 · LLM, NLP
NAACL
NAACL-2022 MoEBERT：from BERT to Mixture-of-Experts via Importance-Guided Adaptation
2022-07-29 · LLM, NLP
arXiv
arXiv-2022 Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
2022-04-16 · LLM, NLP, transformer
OpenAI
OpenAI-2022 Training language models to follow instructions with human feedback
2022-03-16 · LLM, NLP, transformer
ICLR
ICLR-2022 LoRA：Low-Rank Adaptation of Large Language Models
2022-01-29 · LLM, NLP
NeurIPS
NeurIPS-2022 Chain of Thought Prompting Elicits Reasoning in Large Language Models
2022-01-28 · LLM, NLP
Journal of Machine Learning Research
Journal of Machine Learning Research-2022 Switch Transformers：Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
2022-01-16 · LLM, NLP, transformer
2025
arXiv
arXiv-2025 Evaluating Large Language Models in Scientific Discovery
2025-12-17 · Agent, LLM, NLP
NeurIPS
NeurIPS-2025 AI-Researcher：Autonomous Scientific Innovation
2025-12-08 · Agent, NLP, LLM
EMNLP
EMNLP-2025 From Automation to Autonomy：A Survey on Large Language Models in Scientific Discovery
2025-11-04 · Agent, NLP, LLM
arXiv
ACEBench：Who Wins the Match Point in Tool Usage
2025-09-08 · Agent, LLM, NLP
arXiv
arXiv-2025 The AI Scientist-v2：Workshop-Level Automated Scientific Discovery via Agentic Tree Search
2025-04-10 · Agent, LLM, NLP
Nature Computational Science
Nature Computational Science-2025 SciToolAgent：A Knowledge Graph-Driven Scientific Agent for Multi-Tool Integration
2025-01-24 · Agent, LLM
ICLR
ICLR-2025 ToolACE：Winning the Points of LLM Function Calling
2025-01-23 · LLM, NLP, Agent