LLM Concept Vectors: MIT Research on Steering AI Behavior

Date: February 23, 2026
Source: Science

Researchers from MIT and UC San Diego published a paper in Science describing LLM concept vectors and a new algorithm called the Recursive Feature Machine (RFM) that can extract these concept vectors from large language models. Essentially, these are patterns of neural activity corresponding to specific ideas or behaviors. Using fewer than 500 training samples and under a minute of compute on a single A100 GPU, researchers were able to steer models toward or away from specific behaviors, bypass safety features, and transfer concepts across languages.

Furthermore, the technique works across LLMs, vision-language models, and reasoning models.

Why LLM Concept Vectors Matter for Developers

This research points to a future beyond prompt engineering. Instead of coaxing a model into a desired behavior with carefully crafted text, developers will be able to directly manipulate the model’s internal representations of concepts. Consequently, that is a ...