arXiv cs.AI / cs.LG / cs.CL·8d agoAttention Function as an Intrinsic Inductive Bias: How Models' Behavior Diverges in Novel Contexts#transformer#attention#mofaAI research2