Yoon Kim

I am an assistant professor at MIT (EECS/CSAIL). I obtained my PhD in computer science from Harvard University, where I was advised by Alexander Rush.

yoonkim@mit.edu / CV / Google Scholar

Research

I work on natural language processing and machine learning. Current interests include:

Efficient training and deployment of large-scale models
Understanding the capabilities and limitations of language models
Symbolic mechanisms for controlling and augmenting neural networks

Group

Postdocs
Hadeel Al-Negheimish

PhD Students

Lucas Torroba Hennigen

Former Members

Teaching

6.S986: Large Language Models and Beyond (Spring 2024)
6.8610: Quantitative Methods for Natural Language Processing (Fall 2023)

Recent Papers [all publications]

Parallelizing Linear Transformers with the Delta Rule over Sequence Length

paper

code

slides

Learning to Decode Collaboratively with Multiple Language Models

paper

code

What Do Language Models Hear? Probing for Auditory Representations in Language Models

paper

Gated Linear Attention Transformers with Hardware-Efficient Training

paper

slides

code

In-Context Language Learning: Architectures and Algorithms

paper

code

Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks

paper

code

LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuning

paper

code