Induction Heads and In-Context Learning Mechanisms
Researchers trace in-context learning to a simple copying circuit in transformers.
Idris Petrova
Section
1 story in Mechanistic.
Researchers trace in-context learning to a simple copying circuit in transformers.