Research
Attention Manifolds: Steering or Blocking Language Models by Editing Learned B-Spline Surfaces
Researchers introduce attention manifolds, learned 2D B-spline surfaces that modulate value dimensions in transformers based on query-key interactions…
Research
#attention manifolds#transformers#model steering#B-spline surfaces#LLaMA#Perplexity#Perplexity AI